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* I. INTRODUCTION 



Ls report summarizes the in-school field operations pad data col- 
lection activities, as well as the administration decision-makiiHj, under-' 
taken in Tear 11 bf the National Assessment program by Research Triangle 
Institute on behalf of the ^Education CommissioA of. the States* It covers 
a time frame of some seventeen month£ — — from March, 1979 through July, 
1980. ' * 

Contained 1 herein are what are considered to be the more pertinent 

/ 

Nummary data on the planning knd conduct of Year 11 in-school assessment. 
AXsq included are details, in summary form, on Qt) National Assessment 

/ 

meetings attended and field trips taken by RTI central staff members 
during the twelve riontha ending May 31 t 1980, (2) the inventory (taken 

in the summer of 1980) of NAEP cj&terials and equipment stored at RTI, 

/ 

* and (3) project expenditures* q£ funds and effort. , 

Two quarterly progress /e^obts (RTI Progress Report: Numbers 41 and 

42) which describe in considerable detail the in-school administration 

' / ' ' 

field activities during the period of January 1, 1980.- j|!ne 30, 1980 t 

have been submitted fro ECS by RIl's National Assessment Administration 
% Center. — Some pf the summary tables' in this final report have been 
9 taken directly from those reports* however, a good portion of the summary- 
data tables contained in, this report have been prepared specially for* 
inclusion in this report. 

Generally, lengthy narrative descriptions of Year XI field activities 
contained in .previously submitted quarterly progress reports are not 

l/ v 'Preparation of quarterly progress reports was suspended during 

calendar year 1979 in order to conserve funds. Thus, no reports • 
war* prepared for the period when Year 11 preparatory activities* 
, and Year 11 Age Class 2 assessment wera^arried out. 



reiterated. Instead, those descriptions are simply teferenced to the 

) * * 

appropriate quarterly report/ * Similarly, none of the Project Memoranda " 

- f • ^ ^ ' . 

issued tb the DSs during Year 11 are reprinted in or attached to this - 

;£epo*t, but wljere appropriate, references are rfad'e to gome of "those 

memoranda. Moreover, documents prepared during the fiscal year by the 

in-school administration staff such as training manuals for the field 

s^ff are neither appended nor attached due to their length ajtd the fiact 

* ■ 
that copies of these have been submitted previously to ECS* Less lengthy 

^ \ ' 
items sucfc as the Year 11 data receiving specifications, the Xear 11 

* _ ♦ 

age-class assessment schedules, an inventory of NAEP materials stored at 

to 

RTI, and the Year 11 DS training session agehda'^Si^ appended to this report 

An assessment of out-of-school 17-year-olds (Supplementary Frame 

assessment) was conducted in Year 11- The last sijch special assessment 
* 

was conducted in Year 07. A summary of the Year 11 Supplementary Frame 
assessment field activities is presented in this report- A more detailed 
report will be preparedly i^Tl's Sampling Research and Design Center 
(SRDC)^ covering all aspects of the survey, including xhe sample design 
and execution. 



II. PREPARATION FOR YEAR U ASSESSMENT 



4 

A. General 



Since Year 02, planning for an assessment year has begjjs/ early In 
one calendar year and data, collection activities relatij/g to it have not 
been completed until the summer of thq ne?t calendar ^ear* Thus^ initial 
planning for the Yea* 11 begfn early in 1979 with the review of Year 11 
\ Age Class 2 exercises and the structuring of Year 11 assignments/districts 
Table 1 presents the schedule of major Year 11 preparatory activi- 
ties whlck involved staff from RTl's National Assessment Administration 
Center* In the. sections which follow are summary reports of some major 
t v asta which wex^jiompleted prior to t^e beginning of Year 11 'assessment. 
B. Stimulus Tape Review - '* 

In Year 11, ECS/NAEP made arrangements to\have stimulus tapes pro- 

1/ * * - t 

duced 1>y a vendor in Denver* The Year 11 Age Class 2 fcapes were re- 

viewed by RTI's-Taping and Proofing Coordinator in July, 1979 and her 

co?rections/edit suggestions were .forwarded to $AEP staff at that time • 

RTI f s. Japing and Proofing Coorditiator also reviewed the Year 11 stimulus 
■ * * * 

tapes for Age Classes 1 and 3 assessments later in 1979* 

After all tapes for an age class were approved by NAEP, the taping 
contractor duplicated 65 copies of each, placing two tapes on a single 
"^90 cassette (one tape on Side A and another tape on Side B). Completed 
tapes for each age class were bulk, shipped toj^RTI by ECS and four copies 



of each cassette subsequently were shipped by bus to each DS* ^ 



If In Years 02-rl0> RTI was responsible for the^ reduction of stimulus 
tapes, working through a vendor in Raleigh, North Carolina* 

27 ^ The Age Class 2 and 1 tapes were- shipped on September 13 and Novem- 
ber' 27, 1979* respectively, and the Age Class 3 tapes went out to 
the DSs on January 29 $ 1980, (See Project Memoranda Nos, 6, .11 
and 16) • . * H 



Table 1 



SCHEDULE 0? YEAR 11 PREPARATORY ACTIVITIES 

* X « * 



March, 1979 



April, JL979 




June IS, 19/79 r> ' 



June 22, 1979 



June 29,' 1979 



July |6-23, 1979. 
v. 

July 30-August 3, 1979 
August 6-17, 1979 

August 13-September 7, 1979 
■ 

* 

August 27-0ctober 5, 1979 



Review (for feasibility of field admin- 
istration of Year 11 exercises begins, 

\ * 
Year 11 District Supervisor (DS) PSU ^* ' 

assignments *are determined* 

All Year 11 supplies and handotit materials 
are ordered* 

Introductory materials are mailed from 
RTI to Chief State School Officers. 



) v j 

All ins true t ion al material? are prepared, 

basic printed items required^ for Year 11 

are ordered,, and Year* 11 stimulus tape 

production begins* 

Introductory materials are m£led from / 
RTI to all superintendents and private 
school officials*- ' / 

DS training session at UTI. 

Initial DS contact (by telephone) of * 
superintendents and school officials* 

Mailout of* confirmation letters to 
superintendents and introductory materials 
to principals, * 

DSs conduct introductory meetings and 
retain Exercise Administrators. * 



C. Instructional Materials* , - • ^ 

During the spring* of 1979, it was decided in meetings and telephone 

A • • 

conversations between NAEP Operations and RTI staff that District Super- 
visor and Exercise Administrator training and reference manuals, »very . 
Similar in format^ to^ those used in Year 10, Vbuld be' prepared for Year 11. 
It was also decided that Administrative Instructions for Exercise -Adminis- 
trators would be needed again in Year .11 for the EAs* ui^ during package 



administration to provide specini, ready-tfeference instructions on package 

administration and handouts required for certain packages* 

In April* work began on the Year 11 Exercise Administrator Manual. 

A final draft was sent to NAEP in mid-Uune for review. Final approval 

was received in late June* and the manual was sent to the printer in an 

* order calling for 200 bound copies to be delivered by late August. The 

order was filled on schedule and copies of the Year 11 EA Manual were 

\ 

shipped by bus (to the DSs before Labor Day. \ 

'\ y. ' ♦ - *. 

' >fhe-¥ear'll District Supervisor Manual had .essentially the s*ame 

\ ' ' ' ' ■ • 

chapter and section outline as the Year 10 version. All of the necessary 

rewriting Jjad been completed by mid-/une and drafts of all chapters had 
• ■ * * 

4 been sent to NAEP for* approval before the end of the month. Approval was 
r^celve^ from NAEP in early July and 35 copied were) printed. The Year' 11 
DS Manual was printed on both sides of each page .and each page was re- 
duced to 6-1/2" x 9 to produce a lightweight manual. ^After printing, the 
pages of each copy were punched and insetted in a 7-1/2" x 10", three-ring, 
loose leaf' binder. 

4 The Year ll Age Class 2 Exercise Administrator Adminisj^atiye Instruc 

■ * 
tions (EAAI) were written, in coordination with NAEP, by tKe end of July 



1 ^ 

* ■ 

* . 

.... . 



and submitted to NAEP for approval* Two hundred copies were printed in 
late July ^n<t> shipped to the DSs on September 17, in time for, distribu- 

tion to the £As before they were trained* Additional EAAIs were prepared 

* " ***** * ■ 

for Year 11 Age -Class 1 and 3 assBssmenfe* later in the operational year 

and distributed to the DSs* • ■ 



D, Procurement of Miscellaneous Materials and Supplies 

1 As early as May, 19,79, RTI staff members began ordeptfng, through - 

j " * " * 

local sources, materials and supplies * (aside from mailout materials) which 

* % • ■■ . » - <, . ■ 

■ * ~ —» ■ . 

"would be heeded to carry out Year 11 assessment* #These items included: 

(1) sampling* scheduling, reporting and fiscal fqrmsi ' &) SLFa? (3) DS , 

bCrtiness cards; (4) press releases, school task summaries, confirmatipn 
* t w * * 

memos and various introductory meeting handouts; and (5) return envelopes, 
boxes aqd other mailing^ materials. AIL ot .the materials and items in the . 
above categories w£re ordered by mid- July, 1979jand delivery on most material 

and supplies irebded tor assessment in Year 11 were .received by early August. 

* " +' * * r 

Most of these ifcei^Wfrere shipped via ^tos freight to the DSs on August 10, 

% . > 

1979 (see Project Memorandum No. 3).- . * * 

E* Mailout Materials - % . , ^ . 

■ ate r % 

1. Form Letters and Memoranda 

All form letters and memoranda necessary tb complete the mail* 

- \ 

Quts, to officials of schools In the Year 11 sample were drafted In mid- June 

by RTI and NAEP staff members and were approved by NAjfP early in the next 

qtiarter. Most of the items were sent to^the printer by mid-July and all 

materials, were ^tinted by the f irstyw^V in August. Tables 2 and, 5 list 

and describe all 'letters and memoranda used in the Year 11 mailouts to , 
• H ■ ■ 

school officials. . ' * .* • 



Table 2 



1 r 



FORM LETTERS USED IN MAI LOUTS FROM RTI T(X OFFICIALS OF SCHOOLS IN THE YEAJM1 SAMPLE 



' Recipients 
1. Chief-State School. Of fleers 



ef-Sta 



V 



2. Superintendents and Private 
School Officials * 

(2 'Versions) 

3. Superintendents and Private 
* School Officials - 

(2 Versions) 

4. Superintendents and Priv&te, 
School Officials 

(2 Ve/sions) * : " 

*_ ■ • 

« 4 

5. Principals of Schools 
In The Sample 



6. Superintendent 1 a,. and Principal's 
Thank-You Letter 
• (2 Versions) / 



*MAILOUf v 9CI1EDUEE; 



« 



Letterhead 
ECS 



ECS 



* 



NAEPyRTl 
(Operations) 

:.f 

I* NAEP/BTI 
/Operations) 



NAEP/RTI ^ 
(Operations) 

ECS . 4 



i 



^ Item \~ was "mai 
* V< - Itea 2 wad- ©a 
, - it'em^ was 'ma 




Juna*22. 

uly 16, 
Ju^y 23. 



# ^ t,- ^Jo8t of Item? 4 ahd"5 were mailed by September 30* 



From 
Mr. Scott 

Dr. Forbes 



Mr. .Smith 

* « 
« 

■ 

Mr. Smith 

Mr. Smith 

„ * * 

Mr. Scott 



» 



Purpose 



'■:( 



Xo cbver listsjof schools or school districts 
"selected in eaph state for assessment in Year 
.11. . ' 

To inform recipients of the Selection of one or 
more schools under the^r jurisdiction of 
'participation in Year 11 assessment and Inform 
them that theyvould be receiving a packet' of. 
informational materials from RTi . . * 

To cover lists of schools selected and packets 
of informational materials, to inform recipient 
of future phone call from DS; and co present 
suggested, date for introductory meeting. 

To confirm time, date, and place of introd'uq- i 
torytaeeting set by DS and the recipient and fi ° 
tp' cover the' Principal's Memorandum apd 
Principal* s- Questionnaire*. 

To infqrm recipient of tl^e, date, and place 
of Introductory' mating he/she was, t<f atfen\l , 
and takeover packa^of infonrfatipnal materials. 

To thank super incidents § principals, and * 
coordinators {it one) for the participation 
and help in assessment,* To inform them of ' 
dates for publishing reports. Jo solicit the 
name for the jailing list f^r the HAEP News- 
letter and to request completion of an enclosed 
questionnaire. * , t 
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*\ * , Table 3 

HEHOgANDA USED IN MAILOUTS TO OFFICIALS OF SCHOOLS IN THE YEAR 11 SAMPLE 



1. 



2. 



Recipients 
School ^Officials 



£rincipals\o'f * 
Schools In the 
sample * 



Accompanies 

* ■ 
First Superintendents 1 or 
Private School Officials 1 
Letter from RTI 



Latter to principals of 
schools In the sample 



Purpose * 

To provide recipient with summary of* 
Year 11 assessment schedule; to pro- 
vide Information on school Involvement, 
Student participation and sample selec- 
tion procedures; and to elicit' Informa- 
tion on hew school's and also any changes 
which should be made In jth/5 Listing of 
Schools Selected, 

To provide Information on assessment- 
schedules , school Involvement and 
student participation and to list 
speclfl£ tasks schools must perform 
to 'facilitate the conduct of assessment* 
Al-so provide detailed InstructlorfdKn 
the proper completion of SLFs, 



I 

CD 
I 
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/ 2. Informational Materials , ^ . 

Each superintendent, headmaster (private school official), and 



principal'^ of schools in the Year 11 sajzrple received a packet of informa- 
ti^onal materials describing various aspects ofi National Assessment, ^One 

. y j 

,cx>p£ of !each of the following ite#s was included in esch packet 'of infor- 

, 1/ 

mat tonal materials*. — 

^a. Demonstration Package (including reading and literature 
objectives and sample exercises) 4 

b. Brochure about the National Assessment 'of Educational 
Progress 

c. Memoranda to School Officials, and Principals 

d. NA£P Newsletter (June, 1979) 
: e. \NAEP Publications Checklist 

F. Mailouts to School* O&lclals 

The Tear 11 NAEP _ introductory letters to superintendents (and head- 

t ' * 

masters) were mailed fr^m RTI on Jiily 16, and th^'operations 11 letters to 
superintendents were mailed by July 23. the latter suggested an introduc- 
tory meeting xime and date and also covered the Year 11 info rmat ion at 
materials and memoran^im to superintendents. The mailing of confirmation 
letters to superintendents and the initial mailout to principals of sample 
schools began the</tfeek of August 20.. This mailing was 4bout 98 percent 
completed by *the end of September. The. superintendents 1 confirmation 
letters and. principals 1 informational folders not mai&d prior to the end 
of September involved schooJL districts (1) in which cooperation was pending, 



1/ Although it -ii not classed a piece of descriptive or informational 
~ ^tjriaft a Principal's Questionnaire was sent to all .principals of 
Tear. 11 sample schools (in thp informational material* pocket) for 
them to complete, and bring to the introductory meeting they attended. 
An example* the Principal's Questionnaire also accompanied the \ 
"confirmation" letter to superintendents and private school officials. 



-10- 



4* 



(2) it which che DSs had not been able to contact the superintendent to 
establish an. introductory meeting, or (3) which contained new schools 
selected near the end of September* - 

Most Year 11 mailouts were sent out as scheduled except for the 
small proportion of the superintendents' confirmation letters and prin- 
cipals* packets which were mailed aftq&r September 30 (see above); as in 
recent years, no significant: problems were encountered. 
G. Training Session 

The Year 11 District Supervisor Training Session was held in Research 
Triangle Park, North Carolina at RTI headquarters from July 30 - August 2, 
1979* An agenda of the session is shown in Appendix A. July 31 and August 
1 were devoted to the training of five new District Supervisors who did not 
participate in' Year 10 assessment. Instruction on those days was provided 
by five key staff members from RTl f s National Assessment Administration 
Center.- The mo ruing of the first day's session was devoted ti summary 
presentations on the training week schedule, brgdnization of the staffs , , 
of ECS, NAEP and RTI, and the Year 11 general assessment schedule . That 

afternoon the group received training on. initial school contacts and 

* » 

participated with central staff members in the simulation of phone calls 
to school officials* At the 4nd of the day die five new DSs also -spent 
about an hour completing various RTI/ personnel forms. The Second. day was 
devoted to (1) detailed presentations on proper student sample selection, 

(2) * briefing on the proposed Year 9 11 Supplementary Frame assessment, 

; . ' ' • • • . -v J ■ 

(3) instruction* on* the conduct of introductory meetings, (4) observation 
by the DSs of a mock introductory meeting conducted by a Regional Supervisor 

f a m 

(5) a review of general .package administration procedures ? and (6) ins true- 
tions on proper primary sampling, unit planning and scheduling* 



The eight PSs who worked all of Year 10 be^an their Year 11 training 
in a separate session (from the new DS?) the morning of August 1. TJie 
veterans spent that morning touring RTI and the Research Triangle Park. 
Year 11 procedural changes and areas of emphasis were the primary topics 
discussed In the .afternoon with the veteran DSs. While the veteran DSs 
were taking their tour the morning of August 1> the new DSs observed a> 
group package administration completed with a group of thirteen-year-olds. 
Highlights of the last day of the session (attended jointly by all DSs^ 
included presentations by HASP, and HIE staff. The session was concluded 
on August 1 with the DSs meeting with their respective RSs. 

DS field costs incurred in attending the Year 11 training session at 
RTI tolled $5,142,, for an average of $396 per DS (see Table 4). In Year 08, 
when only eleven DSs attended the training session in North Carolina, field 
costs averaged $302 per DS, while field costs fj>r the Years 09 and 10 train- 
ing sessions .(held in Denver) averaged $42/ and $425, respectively, per DS. 
H. Initial Contacts With School Officials * „ 

The week after the DS training session, the District Supervisors 
began telephoning superintendents of schools In the Year 11 sample 

to (1) determine their willingness bo participate, (2) estaMish Intro-* 

>l - 

ductory t meetlng dates with them or their representatives and the prin-^ 

^ * v 

cipals and coordinators of all sample schools, (3) make any necessary 
* . 

corrections, to the PSU List of Schools Selected? and (4) gather necessary 

* ■ ¥ * ^ 

enrollment and grade-range data on any new schools in the area which were 

* » — ** 

opening for the first time in the fall of 1979. The DSs were* instruct e4 
to make an attempt to call each superintendent in the\period from August 4 
6-17 and to complete all of their Initial contacts by August 24. In 



1/ Headmasters of private schools in the Year 11 sample also were con- 
tacted in the same manner as Superintendents of/public end parochial 
1 sample schools 1 * * * 4 , 



• > -12-, 



• 4 • Table 4 

• COMPARATIVE DS FIELD-COSTS'.INCURRED IN ATTENDING 
TRAINING SESSIONS IN YEARS Ofr-09, 10, AND 11 
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Year. 11 <13 DSs) . 


/$2„769' 


$652 


$1(562 




$5,142 


$396 


* * 


Year 10 <13 DSs) 


3,530 


148 

* • 


;,76i 


282 • 


5,521 


425 




xear 09 tiz DSs) 


— 

2,900 


- 

* 280. 


1,834 


308 


• 

5,122 


427 




Year 08 (11 DSs) , 


1,722 


149 


1,238" 


216 


3,325 


.302 
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some instances, superintendents could not be contacted by August 24 due 
to late school openings or superintendents* being out of tHeir offices 

on extended trips or vacations* By late September, however, virtually 

- • ' * ' 

all initial contacts with superintendents of schools selected in the < 

* * > / 

Ye&r 11 sample had been completed, including most of those wi^th superin- 

tendents of* "new 11 and supplementary schools selected after the initial 

sample of schools had been identified (see Chapter III}* 

v. 

* * 
I* Introductory Meetings 

The District Supervisors, in their calls to superintendents and 

¥ 

headmasters (see above), scheduled introductory meetings with sup^rin- 
tendents, principals and coordinators of schools in the Year '11 sample* 1 
The great majority of these meetings were scheduled in the six-week 
period from August 27 through October 5* The Year 11 introductory 
meeting schedule for each Primary Sampling Unit (PSU) established by 
the District Supervisors in their initial^ontacts with school officials 
is shown In Table 5* In thesfe meetings the. District Supervisors were re 
quijred to: - \ * 1 * 

i (1) Answer any questions the school officials in attendance s 

might haVe regarding National Assessment; 
(2) Explain the taslc§ required of each school participating 

in National Assessment^ * * * 

, Nr r ; 

* ( (3) Distribute Studept Listing Forms and explain taethod, of 

cpmpletion; 

(4) Determine the dates of assessment; ^ • - 

(5) Complete the PSU/ Control Sheets; 

(6) Collect completed Principal's Questionnaire; 

* • A, * • 

(7) Obtain information on schools With special sessions; - + 1 



7. 
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PAGE 14 TABLE 5 - 

OMMITTED DUE TO CONFIDENTIALITY 



* 1 



\ 



X 



* r 



1 



f o , * * . , 2,3 

ERIC 



(9) Inquiry about possible EA* Candida tes^wj^ir nece ssary) , 
About §5 percent of all Year 11 introductory meetings were set up 
to be completed by October 5,,the last day the meetings ifere initially 
scheduled to be held. Those meetings which had to be held after assess- 
ment began on October £ primarily involved schools from which cooperation 
* was pending at the end of September,. 



"kj. summary of year ii~ in-school; assessment p 

■ 

f 

A. The Prltnary Sample 

The Year 11 primary sample c6nsisted of 83 Primary Sampling Units 
(P^Us) containing 162 replicates. «he 83 PSUs, which were made up of a ' 
single county .or a cluster of counties, fell in 77 geographic locations, 
or sampling points. As in Years, 07-10, one week Vas allotted in the 
Year 11 schedule ^ complete assessment* in two replicates. Thus, comple- * 
tion of assessment in an age class in Year 11 .called for 81 weeks of r 
assessment. , 

B. Schedule of Activities 

T^g— , ^ - x 

1., Preparation for Regular Assessment 

As indicated in Chapter II, aliBost? all the central staff effort * 

A a », 

expended in preparation for Year 11 in-school assessipent (procurement of 

materials and supplies, development pf basic Instructional materials, mail* 

* y x 

outs to superintendents and private school officials and to principals of 

sample schools, etc.) had been completed before October, 1979/ Detailed' 

* 

Ascriptions of all preparatory activities relating to Year 11 Were pre- 
sented in Chapter II of this report. m # 
2. Conduct of Regular Assessment 

* As In Years 01-10, Year II in-school' assessment involved three 
age p lasses: ( : " 

Age Class * Group w 'Born*. - j 

m 

\ „ 

1 Nine-year-olds During calendar year 1970 

2 Thirteen-year-olds During calendar year 1966 

3 1 Seventeen-ye*r**oIds During, the period, of ld/1/62 

through 9/30/63 c - 



.25 / • • 



V 1 • • 

'Also as in previous years, age-eligible students enrolled in < _ 

sample ^hools but who dould not speak English, Irtio were classified as EWt, 

pr who were determined as functionally disabled were excluded from the / 

' . 

sample universe. , * 

* The schedule for the Year ll regular in-school assessment was 

. ' ' " V. ■ - \ 

established at the beginning of the v assessment year as follows: ✓ 

Age Clasp 2 -'JDctofter '& through December*^, 1979 " / 

Age Class J. - January^ 2 through tfarcl^- 7, 1980 

• Age Class 3 - March 3 through flay 9i 1980 
Schedules for each age. class, shoving, by*DS, w§en each Primary Sampling 
Unit (FSU) vas actually scheduled for assessment, are contained in Appendix 
B. As vas the experience in all previous assessment years, some DSs were . 
unable to complete assessment in their districts according to the schedules 
they established In their introductory 1 meetings. By-PSU listings and ex- 
planations of these' schedtiWdelays are given In 'A^peu^ix C. 

In Year 11, the total, assignment across all age classes consisted 
of 40 unique group packages. This compares to total^'assignments of 35 group 

* • * X 

packages in Year 09 -and 41 group packages in Year 10. All Year 11 packages 
contained some combination of Reading and Literature exercises. There 
also were seven Art exercises in one. Year 11 Age Class 2 package. At each 

age class, thrtfe Year 11 packages vere made, up of exercises recycled from 

* J#f - * ■ * 

Years 02 and 06; all other Year 11 packa'ges^ere made up of exercises 

* f '/X ' / * 

which had not bejsn administered in previous years. Table 6 shovs the dis- 
'* 

tribution of Year 11 packages by composition (either nev or recycled exer- 
■ 

cised) and by age class. 1 



Tab]>e'6 

• m * 

* > i Year 11 Packages 

<By Age Class and Composition). 



Age Class 



1 



2 
3 



Total 



All New 
Exercises 

3 

3 

_3 

9 



Ninaber of Packages 



All Recycled 
Exercises 

8 

12 

11 

31 ' 



Total 
Packages 

11 

15 

14 

40 



A 



9 ^ 3 S Other Scheduled 'Activities ' * « 

Besides the actual conduct of Tear 11 assessment, the DSs and 
central "staff vera engaged during the contract period in a number of other 
activities which were associated with the regular^Wtfdhool assessment 
program* The mora important of these are listed in Tabled. All the 
major tasks listed in Tq^Le 7 were completed on or ahead of schedule* 

C. Schools Selected For Assessment * > 

* 

Table 8 presents a summary of tha schools selected in the Year 11 

& - ' 

secondary sample, by region, £^1 each .age class. A total of 1,740 schools 
comprised the Tear 11 secondary sample, 5.6 percent less than in Year 10, 
wtjeji 1,844 ."were selected* This reduction in sample s£ze was due to a 
special mathematics assessment (AAM) in Year 10 which required more sample 
schools. 

* * 

Table 9 gives, by region and by age class, counts of schools added 

to the Yearvil secondary sample after the' initial selection had been bade 

in the summer of 1979. Of the 54 schools added, three were schools opening 

for the first time in September, 1979"* or had experienced a grade-range 

u change after the 1978-1979 school year (and had no probability of selection 

1/ 

in tfie initial* secondary-sample draw — ) , and 51 were added to replace 
• refusal {fchools. ^ . 

D. Completion Rates 

_ — Table? 10 and l£ present summary data, by aga class, on the number 
, find percentage of sessions completed and students assessed during Year 11. 



~T7 The Year 11 secondary sampling frame was constructed from listings 
; of schools existing during the 1978-79 school year. 
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-•-20- 



t-. ii. Table 7 * -*.* 4 -e. 

«* ' • 

OTHER MAJOR- SCHEDULES* ACTIVITIES ASSOCIATE!) <&ITH TEAR 11 
IN-SCHOOL ASSESSMENT 

(In Fiscal Year ■ 1979-1980) 



1. 



2, 



Activity 



Review of %ge Classes 
1 and 3 stimulus tapes 
for Year 11. ' ' 9 - 

DS telephoife contact with 
most principals of schools 
in Age Cla£s 3 sample -to 
inform them when DS will 
arrive to draw student* - 
samples » ^ 



Dates Scheduled 
October 1, 19 7 9 -January 31, 

December 10*-20, 197> 

* 



1980 



3. 



4. 



5. 



6. 



7. 



DSs begin' contact with Age 
Clears 1' schools to reconfirm 
assessment schedules. 

d % 

s organize materials and 
prepare in other ways for- 
Age Class 1 assessment. * ' 



5 



DSs complete telephone con- 
tacts with (remaining officials 
of Age Class 3 sample schools* 

DSs draw student samples in 
mostr^ge CJeds 3 school** - 

DSs acquirtf Supplementity : 
Frame lists* 

ir *■ r 



December 10-20,' 1979 



December 10-20, 1979 



January 2-lttrch 7, 1980 



January 2-M4rch 7, 1980' 



March 3-M*y 9, 1980 



* 4 



ill 4*C JL 
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Table 8 . , 



v. • 1/ 

7- • -HBHBER OF SCHOOLS SELECTED IK YEAR 1\ SAMPLE - 



. 4» 

• 


Region 1 

*- 


Region 2 


Region 3 


1— 

Region 4 


Total 


Age Class- 1 


^ 1^8 


125 


191 


154 


*08 

s 


Age 4a3*akl2 * 


154- ■ 


145 


192 


151 


642 


Age Clas^3 


> 107 


103 


145 


135 


490 


Total , Year |11 Sampl 


c" -/ I 399 


373 


528 


440 


.1,740 



Vf Includes schools selected for participation In Year 11 after the Initial 
"~ secondary Sample had beet* drawn* . 

^ s • . - ) 



Table 9 

'NUMBER OF SCHOOLS ADDED TO INITIAL YEAR 11 SECONDARY SAMPLE 
AFTER INITIAL SECONDARY SAMPLE SELECTION" 2/ 



« 


Region 1 


Region 2 


Region 3 


Region 4 


Total 


Age Clads 1 


2 


1 


0 


13 . 


16 


Age Class 2 * 


6 


4 


4 


4 


18 


Age Class 3 




3 ' 


" ^ 2 . 


_9 


20 


Totals Year 11 Sample 


14 


8 


6 

r 


26 


54 



2/ Three were selected as a result of sample updating operations* 
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SESSIONS COMPLETED AND STUDENTS ASSESSED 
.YEAR 11 REGULAR ASSIGNMENTS 



r 



Age Class 1 
Age, Class 2 



Age C^LaSs 3 
Year 11 ' - 



r 



no: 
x 

No. 
X 

No. 
X 

No. 
X 



Sessions 
Assigned 

1,764 
■100.0 

* 2,380 
■ ' 100.0 

2,455 
100.0 

6,599 
100.0 



Sessions 
Completed 

1,764 
100.0 

2,352 
98.8 

2,425 
98.8 

6,541 
99.1 



Students 

Expected Students Actually 

To Be Assessed/Completion 

&00A00A*! ' ' f>-.^-. O / 



Assessed — 

32,200 
100.0 

48,295 
100.0 

46,627 
100.0 

127,122 
100.0- 



Rate II 



29,013 
90.1 

41,488 
85.9 

36,027 
78.0 

106,528 



1 * . • 

■ 1/ Adjusted to the lower of the number of Students assigned to be assessed 
i in each .sample school or the number of eligibles enrolled in each sample 

v / schools 

* ' 

21 Completion rate for Age Classes 1 and 2 is ratio of the number of students 

assessed to the number of students expected to be assessed. For Age Class 

3, it Is (1) the initial response rate (no. assessed £ no. expected to be 
' assessed in initial sessions) plus, (2) the percentage of nonrespondents 
in -^o-llowup schools times the followup response rate. 



-Table 11 



'SESSIONS COMPLETED AND STUDENTS ASSESSED 
■. YEAR 11 STANDBY ASSIGNMENTS 



Age Class 1 

Age Class 2 

Age* Class 3 
Year 11 



-No. 
Z 

No. * 
Z 

«o. 

No. 
Z 



Sessions 
Assigned 

19 
100.0 

50 
100.0 

22 
100.0 

* 91 

roo.o 



Sessions 



Students 
Expected 
To Be 



1/ 



Co tap let ed Assessed — 



17 
89.5 

40 
80.0 

\, 

11.1 

73 
80.2 



165 
100.0 

• 210 
180.0 

124 
100.0 

499 
100.0 



Students- Actually 
Assessed/Co opletion 
Rate 2/ 



146 
88.5 

196 
93.3 

112 
90.3 

454 



'1 



Adjusted to the love? of the nuaber of Students assigned to be assessed 
in each sample school or tfie number of eligibles enrolled in,each sample 
school* " 

r » 

Completion rate for Age Classes 1 and 2 is ratio of -the number of students 
assessed to the nuaber of students expected to be assessed-* For Age Class 
% it' is (1) the Initial response rate (no. assessed 7 no. expected to be 
assessed {n initial 'sessions) plus, (2) the percentage of nonrespqndents 
in followup schools tiqes tfce followup response rate. * 



Table 10 shows data only f^^egular assignments, while Table *ll+pre^ents 

sixcmary data only for standby assignments. ' j 

A total of 6,690 group setfsi/ns were assigned on a regular or stfandby 
* * ' \ ' t 
basis in Year 11, Of that nunber, 6,614 or 98,9 percent were completed. 

In those 6,690 sessions scheduled, a total of 127,621 students were ex- 

pected to be assessed, while 106,982 students, or 83.8 percent of the tar- 

* 

get samp'ife,' actually were assessed. In Tear 10, the overall session com- 

pletion rate was 99.6 percent and 82.4 percent of the selected students 

* « 

were assessed Details tof scheduled sessions not completed *re giten for 

i 

the Tear 11 age class assessments .In Appendix C of this final reports Table 
12 also has been included to show, hy age class and reason, regular and 
standby sessions whicfr could not^be completed! 

In Tears 07 an4 08, samples of Age Class 3 nonrespondents from initial 
and makeup sessicfts wetreVelected for foliowup assessment on a subsequent 
date. Ho foliowup asse^s^nt was conducted in Tear 0£ T Silt it was resumed 
in Tear 10, and continued In Tear 11, using a slightly different set of 
sampling procedures which called for the assignm&t of one or two foliowup 
packages to "each Age , Class 3" sample school. The foliowup packages, were 
not administered, however, if at least 75 percent o£ the students selected 
in a school were assessed. Also, under this approach!, nj^ makeup sessions 
j were required/ 9 ^ r 

% The folloyup assessment of sdventeen-year-olds in Tears 07 and 08 
had a very positive effect on bottfAge Class 3 and overall student response 
rates in thtfle years; it qlso bolstered the Tears 10 and 11 Age Class 3 
Student response rate considerably. Tables 13-16 present summary data 
on this past year's Age Class 3 session completion and student response 
rati*.. ^ 
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t . Table 12 

SESSIOHS ASSIGNED DURING YEAR 11 WHICH COULD HOT BE ADMINISTERED 



• >• 


* 




r 




* 

•* 


• ; 


1 

1 


* - 


Reason For* 


• 

, Age Class 1 


Age Class 2 


Age 'Class 3 




Total 


Norladainls t r a 1 1 on 

i / 

No Eligible 
Respondents 


Regular 


Standb? 


ReR^lar 


Standby 




St a^db? 




ar Standby 


0 


2 . 


* 

2 


9 


0 


6 


* 2 


17 


1 School Refusal 

i, 


0 / 


0 


" '26 


0 


27 " 


0 


53 


0 


Other 


0 . 


0 


_0 


J. 


3 




_3 


_1 


Total* 


0 


2 - 


■28 


10 


30 




\S8 


18 



/ 



• J 



. -ERIC 



* » 



34 



-26- 



Table 13 

/ 

SESSION COMPLETION RATES 
Year 11, Age Class 3 
(Regular Assignments) 



■3r- 



'Region 
1" 




Region 



Original Sessions 


Followup Sessions 


Total 


Sessions * 


Assigned 


Completed 


f Assigned 


Completed 


1 % 

I Assigned 


Completed 


550 : 
J 100,0 ; 


• 511 
94.7 


59 

• 100.0 


59 
100.0 


609 
100.0 


570' 
99.5 


489 :* 

100.0 ; 

ioo. a- 


489' 
100.0 

f 638 
100.0 


31 
100.0 

J 

51 ■ 
100.0 


31 
100.0 

• 

51 

- 100.0 


520 

100.0 
* . 

689 
100.0 


520 
100.0 

689" 
100.0 


553 
100.0 


553 
100.0 


84 
100.0 


83 
98.8 


637 
,100.0 


» "636 ' 
99.8' 


2,230 

ipovo 


2,201 
98.7 


225 
100.0 


224 
99.6 


2,455 
100.0 


2,425 
98.8 

• 



Table 14 

SESSION COMPLETION RATES 
Year 11, Age "Class 3 
(Standby Assignments) 



Original Sessions 



\ 



Assigned Completed 



Follovup Sessions 



Assigned Completed 



Total Sessions 



Assigned Completed 



I 


No. 


2 


i 


0 


0 


2, 


* 

1 




X - 


1O0.0 

* 


50.0 


jjy 100.0- 


0.0 


. 100. Q 


50.0 


2' *• 


No. 


5 


3 


0 


0 


5 


3 




X 


100.0 


. 60.0 


100.0 


0.0 


100.0 


60.0 


3 


No. 


7 


5 


1 


v ■ 1 


8 . 






X 


100.0 . 


71.4 


100.0 


aop,o 


( 100.0 


75.0 


A 


T No. 


7* 


-.6 


' "0 


* 

. 0 


7 


6 




X 


100.0 


B5.7 


-100.0 


0.0 


1*0.0 


85.7 


* 














f- 


Total 
• 


No. 


. 21 


15 


- * — 1 


1 


22 


W 




X 


loo.a 


71.4 


'100. Q 


100,0- 


10070 


- \72.7 



Table IS 

f 



STUDENTS ASSESSED 
Year 11, Age Class 3 
(Regular Assignments)' 



Region 



3 
4 

Total 



1 


Original Sessions 


Followup Sessions 


Total 


* * 

Sessions — 




Selected 


• 

Assessed 


•* 

Selected 

m I 


Assessed 


Selected 


Assessed 


Ho* 
% 


11,654 
l no n 


7,802 
0/ * U 


2,047 • 

1 f\f\ f\ 

J.UO* 0 


657 
32.1 ' 


11,654 
100.0 


8,459 
'73^5 


SisJ * 

z 


9,751 
100.0 


7,427 
76.2 


812 
100.0 


352 
43.3 


9,751 
100.0 


' 7,779 
. 79.8 


No. 


13,019 
100. 0' 


10,029 
77.0 


• 1,461 

lod.o 


461 
31.6 


13,019 
100.0 


10.490 
80*9 


No. 

z 


12,203 
100.0 


8,274 
' . 67.8 


2,771 
1 100.0 


1,025 . 
37.0 


12,203 
^100.0 


9,299 
77.6 


Ho. 
% 


46,627 
100.0 


33,532 
71.9 


. 7,091 
100.0 

i 


2,495 
' 35.2 


46,627. 
100.0 


36,027 
78.0 

« 






• 


Table 16 


9 

0 







STUDENTS ASSESSED 
Year 11, Age Class 3 
(Standby Assignments) 



Original Sessions 



Followup Sessions 



Total Sessions - 



1/ 



Region 
1 

2 

3 

4 

Total 



^ Selected t Assessed Selected Assessed Selected /fesessed 



-No. 
Z ■ 


4 

100.0 

+ 


2 

50.0 


0 

" 160.0 . 


0 

0.0 

t 


' 4 
100.0 


2. 
50.0 


No. 

% , 


37 * 
100.0 


35 
94.6 


0 

ido.o. 


0 

0.0 


37" 

100.0 


35 
94.6 - 


No. * 
Z ' 


. 30 V 
100.0 • 


26. 
86.7 


o ' 

100.0 

• 


0 

0.0 


30 

100.0 


26 
86.7 


No. 
Z 


52 
100.0 


46 

92.3 " 


s 1 
^100.0 


1 

100.0 


53: 

100.0 


49 
92.5 


- No. 

. z 


1Z3 
100.0 


111 
90.2 


• • 

100.0 


1 

100.0 


124 
100.0 


112 
90.3' 



11 The sample completion rate for total -sessions was computed as (1) the initial 
^ response rate <no. assessed f no. expVcted to be assessed in initial session; 
. ' plus, (2) the percentage of nonrespondents iti followup schools times the, , 
followup response rate. ^ J * . 
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The nonrespondent follbvup also has had a positive effect 94 the 

I* 

per-package yield. In Year 06, there was an average of 2,314 responses 

» * 

per Age Class 3 package assigned; in Tear 07 the average w£nt up to 2,508; 
in Year 08 the average rose again to 2,544; Year 09 it fell to 2,357; ' 
and in Year 10 it rose to 2,724* some 5 percent over the expected yield. 



In Year 11, package as&ignment procedures were revised slightly, and the 
average number of responses per 'Age Class 3 package was 2,581, which was 
within \ 4 percent of the targe tted average yield of 2,592 responses per 
package. ' 

E. EA Effort and Co ^ | ^ 

Table 17 presents a ^tummary, by age class, of EA effort .expended and 
costs incurred in Year 11; .and in Table 18, various comparisons of EA 
effort and costs for tears 06-11 are given* 

^ In Year 11, EA costs totaled $83,518WL4 and the average EA cost per 
administration (based on total DS and EA administrations of 6,614) jras $12.63. 
Total EA costs for Year 10 were $76*336.59 and the average EA cost per admin- 
istration was $11.57. In Year 11 the EAs completed 73.3 percent of all ad- 
ministrations; in Year 10, the EAs completed almost 71 percent of all package 
administrari^nsT^The DSs administered 1,915 packages in Year 10, as compared 
to 1,766 in ?e*r 11. The rise in average EA costs per administration in 
Year 11 (from Year 10) was due primarily to a 6.9 percent increase in th& 
average hourly wage paid EAs ($5.44 in Year 11; $5.0$ 'in Year 10). 

Tables 19 and 20 have been included to provide details, for each 

Year 11 age class assessment, on EA bpurs charged in performing specific 

* 

activities and on EA costs, by cost category. The distribution of EA 

/ / 

hours and costs ,(by categories) was generally comparable" to the experience 



in other recent years. 

/ 
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Table- 17 

SUMMARY OF EA EFFORT AND COSTS 
YEAR 11 



Totals 



Class 


Ho. Weeks 

-""of ' 

Assessment 


4« 1/ 


Total 
EA Hours 
Char Red 


Average No. 
EA Hours Per 3 . 
Administration— 


Average No. 
EA Hours Per 
Week Of 
Assessment 


Total 
EA 2/ 


Average EA * 
Cost Per _ . 
Administration— 


Average EA 
Costs Per 
Week 0E> 
Assessment 


1 

» 


81 


• 

1,781 


3,888.00 




---48.00 


$25,673.45^ 


$14.42 


$316.96 


2^ 




2,392 

* 

r 


4,465.00. 


1.87 


55.12 


28,^58.17 


11.98 


35 yo 


3 


21 


2^441 


4.425.75 


1.81 


54.64 


29,186.52 


11.96 


360.313 


Year 11 


243 


-6,614 


12,778.75 


1.93 


52.59 


$83,518.14 


$12.63 


$343.70. 



I 

to 
I 



1/ Includes regular and standby administrations in all original and Age Class 3 followup sessions* 

If Remuneration for EA services plus reimbursement for business^connected mileage and other incidental EA 
expenses such as parking and. tolls* Does not include Powerforce, Inc. surcharge. 



3f Based on total administrations* 



I, 



\8 



3D 



"V. 



TAE 



FABLE 18 

COMPARISON OF EA EFFORT AND COSTS 
Years 06 through 11 



St. 



J <4 



tTcttal Administrations 
EVftdpin 1 s tra 1 1 ons 

EA Hours Charged 



( T^tal E 



Averafic-Auftber of £A Hours Per 

^ EA Adffn list rat ion 
*■# 

Average Number of EA Hours Per 
Week of Assessment- -* 



Total EA Costs 
*. 

Average EA Costs Per EA 
* Adminl^cyition 

Average EA Costs Per Week Of 
Assessment A * 

Average EA Hourly Wage 

a — 

Percent of To'tpl Administrations 
Completed *By EAs 



Year 06 


Year 07 


Year 08 

* 


Year 09 


Year 10 


Year 11 

<* 


9,284 


7,490 


5,917 

* 


5,156' 


6,598 


' 6,614 


* 1,981 


5,148 


. 3,744 


3,357 


4,683 


4,848 


5,624.2 


' 10,736,2 ' 


'10,673.7 


^ 7,960.0 


12,629.25 


12,778.75 


2.84 


2. 09. 


* t 2.85 


2.37 


2.70 


2.64 


* * 

8.68 

i 

* 


* 

44.18 

* < 


* 43.92 


32.76 


51??^ 


52.59 


,371.42 


$56,776.38 


$59,391.60 


$48,738.19 

• 


$•,336.59 


$83, *5 18. 14 


$14.83 

• 


$11.03 ' 


$15.86 


$14.52 

t> 


$16.30' 


$17.22 


^A5*.33 


$233.65 


$ V 244.41 


$206T.Sl J 


$314.14 


• 

$343.70 


* 

i $4.33 
21.3 


■ $4.42 
68.7 


$4.51 

* 

63.3 


$5.-06 
65.1 


* 

$5.09 
71.0 


* $5.44 
73/3 



* 

* 

* 


* 

* 


if 
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TABLE 19 
YEAR 11 EA HOURS, BY ACTIVITY 

* 

* 

■ 


V « 

» 

J 


Y 

V 




Training_ 


SLF 
Completion 


Assessing 


Travel 


Other 


Total ' k 


* 

Age Class 1 


120.50 


389.50 


1,946.50 

» * 


j 

738.50 


693.00 


3,888.00 


Age Class 2 


351.75 


232.50 


2,442.50 


618.00 


✓ 

820.25 


4,465.00 


Age Class 3 


152.00 


340.00 


2,384.00 


'. 810.75 


739.00 


4,425.75 


Total 


•624.25 


962.00 


6,773.00 


2,167.25 


2,252.25 


12, 778.-75 


Z* 


4.9 * 


7.5 


53.0 


17.0 


^ 17.6 


100.0 | 










*. 




f 



TABLE 20 
YEAR 11 EA COSTS 





.—Wages 
.■And Fees 


Mileage 


Other 


Total 


Age Class 1 


$20,878.30 


$ 4,210.32 


$ 584.83 


$25,673.45 


.Age Class 2 


24,391.48 


4,071.64 


195.05 


28,658.17- 


Age Class 3 


24,212.17 


4,245.17 • 


729.18 


29,186.52 


Total 


m . $69,48^95^ 


$12,527.13 


$1,509.06 N 


583,518.14 


X 


83.2 


15.0 


1.8 


100.0 


* 

* 

a 


* 


1 

# 


* 


• 


* 


0 

t 

* 4 


4 







i 4 

In Year 11, a total' of 254 Exercise Administrators were retained "by 
the DSs (see Tatjle 21). Of £hat_tp_£aU-32_EAs, did not receive full train- 
ing^ as they participated only in the preparation of SLFs. Based on average 
hourly rates paid to the EAa during each age class assessment, a total of 
$0,396 was spent on training the 222 persons who were instructed in all 
aspects of the EA position. Excluding any incidental EA travel costs # in- 
curred, whiie receiving training (which cannot be associated directly in 
RTI's records with training), it cost approximately $15.30 (on the average) 
in Tear 11 to train each EA retained to participate in regular assessment. 
Using the same computational procedures for Tear 11, it cost an average of 

$17.37 to train -each o^'the EAs who administered packages in Year 10. Many 

• 4 V ' •* \ 

or the Year 11 Exercise Administrators served during pnly one or two age 

'class assessments. Jabl^e 22 shows the number of EAs retained for each 

age class. As # inmost years, more EAs were required to complete the Age 

. - 1 * * -\£ m ' — 

Class 3 assignment's.' 4 m 

F, PS Fleld/jBoltA - % . 

* . Including expenses incurred during August and September, 1979, in 
mailing in^ti^L lontatets and holding introductory meetings, DS transporta- 
tion subsistence and "other" in-school field costs £or all of Year 11 
assessment' totaled $1$9,416 (see Table 23). Field expenses in this period 
of approximately nine months averaged '$11,4-94 per JDS (based on 13 DSs). In 
Year 10, yhen the field staff also consisted of 13 t)Ss, District Supervisor 

field expenses totaled $146, £46 r for an average of $11,280 per DS. 

• . ~ % 

G» Restrictions 



Table 24 represents a final summary of the number and percentage of 
ools imposing restrictions on 1 Year 11 assessment.-' The data' were taken 



1/ For a detailed listing of Year 11 school restrictions, by PSU and 
type, reference is* made co Appendix D* 



Table 21 



exercise Administrators retained during 
' tear 11 in-school assessment 



•* 
• 


Region 1 


Region 2 


Region 3 


Region 4 


Total 


Administered Packages 


57 


70 


49 

1 


46 


222. 


Only 4Coaple ted SLFs 


15 


_7 




_2 


32 


TOTAL 


72 . 


77 


57 

* * 


48 


254 



• Table 22 

EXERCISE ADMINISTRATORS RETAINED FOR EACH AGE CLASS 
ASSESSMENT-IN-YEAR-11 v 



■Age 
Class 


Only 
Completed 
SLFs 


Administered 
Packages 


1/ 

Total » 


r 


5 




98 


2 " . • . 


• 

4 


141 " 


145 


3 


27 


139 




TOTAL 


36^ 


373 

< — 


409 



■ f -I 

1/ Some individuals may have been counted as participating in more 
than one age class* /V. * 



Tables 23 




1/ 



SUMMARY OF DS FIELD EXPENSES BY ACTIVITY - 
' YEAR 11 



2/ 

Transportation 11 Subsistence 



Other^ 



1* - Attending Year 11 DS Training Session 



2. Making Year 11 initial contacts and 
• conducting Introductory meetings 

\* 

Conducting Age. Class 2 assessment 

4. Conducting Age Class 1 assessment 

5. Conducting Age Class 3 assessment 
TOTALS 

Average Per DS - 



% 3,421.61 
12,526.07 

18,634.78 

16,711.67 
I" 

17,219.32 
$68,513.45 
$ 5,270.27 

t 



$ 1,562.45 
7,983.22 

» 

13,463.13 
12,524.16 
11,847.55 
$47,380.51 
$ 3,644.65 



$ 159.44 
. 5,001.35 

11,343-47 
6,996.21 
* 10,019.13 
$33,521.60 
$ 2,578.58 



TotaL 



$ 5,143.50 
25,510.64 

43,443. 3ff . 
36,232.04 
39,086.00 
$149,415.56 
$ 11,493.50 



1/ Includes expenses incurred In August and Septeaber, 1979 by DSs Co attend Year 11 Training Session, oake 
Year 11 Initial contacts with school officials, and to complete most of Year 11 Introductory meetings. 

• * 

— -If Fare*, auto rentals and. buaineaa use of personal autos. , ~ 

• * 

3/ Comunications and .shipping, parking, tolls, etc* 



• 45 



46 
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Table 24 

SUMMARY OF TEAR 11 SCHOOL RESTRICTIONS 



1^ 

f 



> 



1. 



2- 



3* 



4. 



5. 



6, 



Required school In- ^ 
formation letters »x 
press releases, etc., 
be sent to parents 
before or- after 
assessment* 

Required that project 
informational letters 
be sent to parents 
before assessment. 

Requested written 
permission from 
parents before 
assessment. 

Would aot^aUov one 
or more exercises to 
be administered. 

Would not allow one 
or more Background 
Questions to be 
administered. 

Other* v 

Totals 

X Of Total Schools 
Selected 



* Huabcr Of Schools 
Age . Age Age 
Class Class v<k Class 



" 9 



121 



•111 



12 ■ 



5 

152 
25.0 



*• 

, 8 

131 
^20.8 



8 




8 

79 
16.1* 



Total 



19 



288 



23 



11 



* 362 
. 20.9 



y^Total 
Restriction 

5.2 



79-6 



6^4 



0.Q 



3.0 



5.8 



100.0 



9 

ERIC 



47 
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from the Refusal/Restriction section of the District Supervisor Weekly . 

f 

Status Report filed in Year 11 by the DSs. As in Year 10, proportion- 

ally more Age^-Class 1 school officials placed some restriction or condi- 

Lon on the conduct of assessment in, their schools than did. officials of 

ie Class 2 and 3 schools, and over 75 percent of the Year 11 restrictions 

fell In one category — schools requiring that informational l£tc*rs be 

senG to parents before assessment. m It also should be noted that no Year 

\ " * 
U sample schools would not allow one or more exercises to be administered 

to th\ir students* That type of restriction was last encountered in Year 

07. All told, 24.0 percent of the Year 11 participating schools assessed 

imposed\some sort of restriction on assessment. In Year 10, 22.2 percent 

of the sample schools participating restricted the conduct of assessment 4ty 

in some cpnne^, and in Year 09, otily IS. 7 percent of the participating 

schools wc^tfe classified as restricting* assessment* ^ » " * 

H. Refusals 

Table 125 presents a summary, by region and age claqs, of school re* , 

1 I ' ' i/ 

fusa^s received in Year U. In Year 10, 152 sample schools out of 1,762,- 
selected sctools refused to participate; in Year U, a total of 119 sample 



schools out 



of 1,740 selected schools were classified as refusals. 



^ A totaJj of 71 schools selected r in thd Year U sample expressed opposi- 
tion to participating' in the program and th^n later agreed to participate 
x (see Table 26). Such opposition generall^ w*a first encountered either in 

response to the # initial HAEP and RTI letters to superintendents or in the 

# * * 

DSs* initial telephone calls to superintendents. These reversals in attl~* 

. it 

tuda Involved 4.1 percent of the, total. Year 11 school sample and they re- 

present a conversion* of 37_*percent of £11 Year 11 school cooperation problems. 

If Schools ielecced for the special twelfth 'grade 'tJk assessment were 
not Included in this count. - _ , 



Table ^25 



TEAR 11 SCHOOLS OFFICIALLY CLASSIFIED AS REFUSALS 



Region Age Class 1 



1 






4 


* 

«- 3' • 


4 


• 

4 • 


14 


Totals 


32 


/ 

* 




* 

♦ 

• 


* 

• 



Age Class 2 

• i 


Age Class 3 


Totals 


"'. 16. 

< 


.„ 14 


40 


4 


7 


15 




9 


'24 


10 


16 


40 


41 " 


46" 


119 



_ x Table 26 

TEAR 11 SCHOOLS WHICH" .INITIALLY EXPRESSED OPPOSITION 
AND LATER AGREED TO' PARTICIPATE ' 

♦ ♦ 

' ' ■ c - 

Region Age Glass 1 , Age Class 2 Age Class 3 Totals 



1. * 


13' 


11 


10 


34 


2 


.6 


* 


* 

3 


• 15 


' r 








3 


2 


•2 

# 


1 


5 


« 

4 


_6 " 


5 


_6 


17 


Totals 


- 27 


24 


20 


' 71- 



- . • I 

-38- «■ 
m 

- It is noted that in Years 10* and 09 final reversal rateji "of 3.2 and 2*2 
percent, respectively, were achieved* The Year 11 conversion rate £or 
schools expressing opposition to participation in assessment was the high- 
est in the eleven years that National Assessment has been Conducted* 

I. School Response 

. • * r 

i 

A total of 1,740 schools were selected fpr assessment in Year 11 (see 

» - ^ , 

Table 27)* Excluding the special twelfth grade AAM 'school sample, this 

* 

represents a 1.25 percent decrease from the number of schools selected in 



ipresgn^s a 1.25 percent dec 



.the Yea**lQ sample (l,762)*y Of the total number of schools selected, 13.4 

percent fell -into one of the nonresponse categories ("refused",, "closed",. 

"no eligibles~enrblled rt , or^tl^er"), "while - in TearTO assessment was not 

conducted in 16.6 percent of "The schools selected. The unadjusted school 

refusal rate ^ dropped from 8.6 percent in Year 10 to 6.8 percent in Year 

11. As was the experience in previous assessment years, a higher percen- 

tage of schools in the Age Class 2, Year 11 sample reported that no eligible 

students were' enrolled than did schStols in the Age Glass 1 abd 3 samples. 

RTI's Sampling Research ttbl Design Center staff has provided data on 

Year 11 school cooperation which is summarized^in Table 28. ^Based on 

those, originally selected schools, less those schools which were found to 

be closed or no longer having inW^nge grades, the Year 11 cooperation rate 

was 92.9 percent. In Year *10, the overall school -cooperation rate was 91.3 

percent * • 

*Of the 1,740 schools selected for assessment % in Year 11, 1,596V91.7Z). 

were considered "unique-Schools ; m i.e.* schools that are counted only once even 

' • * 

though the school 51*7 be selected in more than one age class sample (pee Table 

1 -- \ 

29). The Year 11 sample contained schools from an estimated 711 districts. 




m 1/ Based on total schools selected. 



Tabie Z7 

SWMARY. OF SC&OOL RESPONSE 
YEAR 11 



l 



Assefrsaent Conducted 

Refused* 

Closed 

No Eligibles Enrolled 
Other 

Total Selected 



• 

* Age Class 1 


Age Class 2< 


\ 

Age Class 3 


Total Sample 


No, 


Percent ' 
Of Total 


No. 


Percent 
Of Total 


Wo. 


.Percent* 
-Of Total 


No. 


Percent 
Of Total 


560 * 


92.1 


534 


S3. 2 


412 




1,506 


86.6 


32 


5.3 


41 


6.4 


46 


\ 


119 


6.8 


6 


1.0 


10 


^1.6 


2 


0.4\ 


18 


1.0 


10 


1.6 


54. 


8.4 


28 


5.7 


92 


5.3 


0 


0.0 


•3 


U 0.-4 


2 


V o. 4 ' 


5 


0.3 


608 


100.0^ 


642 


. 100-0 


490 


100.0 ; 

• 


1,740 


100.0 



.1/* One school selected in the sample fpr tfte northeastern Region was/not in 
* existence; also, two schools in the sample .for tlie Central Regipd were found 
to be in nonsample counties and, thus, were elimliiatea^f luw- Life Year 11 sample 
• of schools. ■ ' , 4 

2/ Theae schools wer^ found to be situated in a county outside of the.PSU in which 
" they were selected and werfe dropped from the sample. 



Tfcbie 28 , 

- * * ■ 

SUMMARY OF SCHOOL COOPERATION 
YEAR 11 



^No. of originally selected 
schools (A) 

,No. of original out-of -range 
or closed schools (B) 

No. of original refusal 
schools (C) 

Cooperation rate ^(a^b^* 



Age Age 

Class 1 Class 2 
— ^— ■ — — j 

590 , 623 

y 



16 



32' 



^94.52 



41 
93.22 



I . I, 



• -41- 



J 

*• * 

■% 


• 

/ 


# 

Table 29 




* 


"ESTIMATED NUMBERS OF UNIQUE YEAR 11 SAMPLE SCHOOLS AND DISTRICTS 




4 


•V 




-»* 








% 


— l 


366 


163 


- " t 


• 2 


342 


152 






. 484 ' 


216 






. 404 


180 " ~~ 


f 


N * Totals'* 


1,596 

• 


711 

• » 


* 

r . ■ 






/ 

* 


i 

f 









f ' 
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5* 



V 

* 



4 i 

4 » 
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In Year^lO, it was -.estimated that the secondary sample, consisted of 1,674* 
*- unique schqols (out of a total of 1,762 non-AAM sample schools) in 74^* 



- • • district s. „ / 

* * v J* Thank-You Letters * t * — 

* „ % m During Tear 11, RTI mailed approximately 2,500 thank-you letters, 

. accompanied by a quality check questionnaire and NAEP Newsletter subscrip- 

ti^n carti, to cooperating" school officials at district and school levels. 

The first Year 11 thank-you letters ware produced in late October,. arriving 

in the first Age Class 2 PSUs assessed approximately two to three xeeks 

after completion tff the assessment in those PSUs. m A similar thank-you 

•* « 
* * ^ * ■ ■ 

letter maiJL^ng schedule was followed throughout Year 11* < ^ * 

^he Year J£, thaftk-ydu letter requested the recipient. to aompletPthe 

questionnair^Cand Send ^Tto WAEP in an enclosed postpaid, jeturn envelope* 

^ . ■ : ~ " f % w T . - ■ * - 

The recipient ~was # alsp informed* by the Year 11 thank-you letter that he or 

■A* * . " » 

she wJttld receive copies o£ reports from the 1979-80 assessment year in^ 

- v_/v . ' 4 * . 

early 1981. \ * . 

The las*tof the Year 11 thank-you letters were mailed from RTI in 

: \ 

. Hay, 1980. No problems were encountered during the year in -carrying out 

■* - * * * ' * 

the procedures or In adherlft£*to the mailout* schedule. 

— I ^ m 

K. Review of Check-In Procedures' and Initial Data Received 

" ~ : * f = 5 a ' 

On October ^30 and 31, the NAEP Director of Liaison and the RII National 

Field Director visited DataScore headquarters in Iowa Qity, Iowa to: 

. . . . 1. Review the WLC/MRC receiving specifications for Year 11 Age 
. t * - Class 2; and . 



** Jf, "J? Review the initial hardshells being returned from the field 

to insure that- data of Acceptable quality were being collected. 



* As a result of this review, soto modifications were made to the re- 
ceiving specifications -'in order toflaake them- appropriate for Year 11 



1/ The Year 11 Age. Class 2 receiving specifications are included as 
q "/ ~~ -Appendix E. f 
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operations* The review also turned up several minor problem areas re- 
laWng to the completed wor^ being received at DataScore. Project Memo*-, 
randum No* 9, vhich identified thesejRprd^lems and provided instructions 

7 - . ; * '« 

on the correct handling of each, wa^ sent to the DSs on November 1.* 
L. Personnel Changes « 

In March, 1978, Louis Monaco, a District Supervisor working in the 
New York-New Jwsey 'area, resigned* It was decided no replacement would 

v * * r - * 

be hired to fili^tbtf vacancy in the field staff created by Mr, Monaco's 

* /* * 

resignation, and the remainder of his Year 10 assignment was completed by 
central staff personnel* Then, at the completion of Yea? 10 assessment in 
May, 1979, two other DSs, Fred Schaefer and Susan Golling, resigned to 
pursue other interests. 

Bufp after most of the planning for Year 11 assessment wajs complete, 

it was thought that only three replacement D£s would have to be recruited 

^ - ' ■ > 

in the summet of 1979 to bring the field staff up to full complement for 

Year 11. Howjever, two more DSa, Joanne Fraser and Anne Stanley, resigned 

4 

in July just before Year 11 operations began/ 

. After two unsuccessful recruiting trips tb New York City to fin3 a 
replacement for Mr* Monaco, # Jo Armstrong was interviewed at RTI and moved 
from Buen^ Vista, Virginia to New York City to fill that, vacancy. * 

v 4 

— Ma% Fraser was replaced by the hiring of Michael Hartsf ield* who* re- 
.sided in Spokane, Washington* Ms* Fraser had Priced her Year 10 assignment 
while baaed in San Francisco, California; however,, it was felt that Spokane 
was a more optimjum location for a DS working th^Northwest in Year 11 than 
San Francisco \ Mr. Hartsf iald resigned 4s a District Supervisor at the end 
rof his first we^k on the job* lie was quickly replaced by Holbrook Williams 



who was specially trained at RTI and then moved from Maine to Spokane* 

Ms. Golling's and Mr. Schaefer's positions™n Pittsburgh and St* Louis 
were filled in July, 1979 by the hiring of Sheri Sivit2 (Pittsburgh) and 
Patricia Henderson (St* Louis)* After expending a considerable amount of 

effort to fill the vacancy in Detroit created by Ms* Stanley's resignation, 

» 

Judy Lawrence was interviewed' late in July and offered the job* She ac«- 

\- 

cepted in tine to attend the Year 11 DS training session at RTI* 

There were two DSs who resigned in December, 1979 after Tear 11 Age 

Class 2 assessment was completed — Ms. Sivitz and David Libon, a DS work- 

ing the Northeast from a base in the Boston area* A third DS- position was 

vacated in December, 1979 when Paul Haagen, who was stationed in S$n Antonio, 

transferred to RTI's Survey Operations Center as a Field Supervisor. 

Marguerite Stone, a veteran Exercise Administrator in the Houston 

area, agreed to complete Mr* Haagen f s Tear 11 assignment in Texas and Ok- 

lahoma. She received classroom instruction from Mr. Haagen the last week 

in December, 1979 and her Regional Supervisor completed her training by 

being in the field with hec during the, first week of Age Class 1 assessment 

in January, 1980* # „ 

Replacements for Ms. Sivitz and Mr. Libon were recruited for the Pitts-. 

burgh and Boston districts in mid-December, Nora Etkin replaced Mr. Libon 

* * 
and Kathy KcCauley took" over the Pittsburgh assignment vacated by Ms., Sivitz* 

Ms* Etkin and Ms. McCauley vera trained initially by central staff members 



ac RTI during the last week .in December, 1979 and also further trained in 
the field in January during the first week of Age Class 1 assessment in 
their districts* 

At th& end of Age Class 3 assessment in May, 1980, nine of the Year 11 

# 

DSs were retained to work through July 31,. 1980 on Year 11 Supplementary " 



Frame assessment* They were: ■ * 

Jo Armstrong: Daniel Glndhart 1 

Andrew Barrett B Timothy Overhuls 
Ann Christ en sen Kenneth Schoenf elder 

Alfreda Ellis ' J t Holbrook Williams 
Patricia Henderson 11 " 

Mr* Schoenf elder resigned in early July to accep toother employment • 

* ■ * 

The other eight DSs retained to participate In Supplementary Frame assess** 
ment worked thrpugh Che end of July, as scheduled. ' 



• ♦ 
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IV. TEAR 11 SUPPLEMENTARY FRAME FIELD ACTIVITIES 

« 

I m 

A# Introduction ^ 

This chapter summarizes the conduct of the Year 11 Supplementary 

Frame assessment data collection activities. A complete report, which 

■ 

will include details on related sampling activities, will be prepared 
by the RXI Sampling Research and Design Center.* 

* The last Supplementary Erame assessment was conducted in Tear Q7 

during the l$75-76 school year. When Tear 11 in-school operations 

- / began In August, 1979, no final decision had been reached as to whether 

or not a Supplementary Frame assessment would be conducted during the 

V 

sussier of 1980. The decision to proceed with the assessment was received 

from NAJJP during the week of February 11, 1980, the decision having 

* A 
been delayed pending the completion of negotiations to secure program 0 \ 

: * 

funding* 

As in other Supplementary Frame assessments, this special assessment 

1 • 

of 17-year-olds involved the selection of a probability sample of indi- 
viduals wjio met the. in-school assessment age-eligibility criteria and were 
potentially eligible for assessment, but who had no chance of being selected 
for participation in regular Age Class 3 assessment due to their having 3 
dropped out or gratjuated^ from high school prior to March 1, 1980. During 

* 

the suamer of £980, an attempt was made to locate, screen and assess each 
v sample individual determined to be eligible. Due to the anticipated 
length of time and Concentration most respondents would require to com- 
plete the reading subject area packages, NAEP and RXI staff decided that 
respondents vpvla be administered a maximum of three packages. Each 



ERJC , • ' .58 H ' ' ^ 



respondent vu paid $5.00 cash for one completed package, $10.00 for two 

completed packages and $20.00 for Ihree completed packages. 

* «■ 

""Donald G. Smith, |XI National Field^birector r for NAEP, served as 

Project Leader for the TJear 11 Supplementary Frame assessment. D. Kirk 

Ppte, RZI Regional Supervisor for HAEP, 'assisted Hr. Smith. Both were 

responsible for the planning organization and "implementation of the 

data collection activities. The District Supervisors _j?ere responsible 

•+ 

* «s * » * 

for presenting the rationale for this special assessment to school 

officials and for collecting the lists of dropouts and early! graduates 

from a subsample of the* Year 11 Age Class 3 sample schools. RII's 

Sampling Research and Design Cente? selected the sample of potential 

eligibles* f rom the collected 'lists*. *The fleldvork was conducted by 

specially trained interviewers comprised of nine Tear 11 of f-sit^e 

District Supervisors and eighteen individuals who were retained on a 

temporary hourly basis. Host-" of the latter group of eighteen indi- 

viduals had served as int eryi ewers on 4 other RTI projects. One RTI 

■ * * V H* 

central staff member was also trained to serve as a back-up interviewer. 

List .compilation and acquisition began on February 18 and was " - 
* 

completed by May 16. All Tear 11 Supplementary Frame forms, manuals and 
Individual Screening Questionnaires, (ISQs) were developed and printed 
and all other field materials t including stimulus tapes) were ordered 
and delivered t6 RTI by late May. The fieldwork began on June 2 and 
concluded on July 31, according to schedule. . * 

The subsections which follow art summaries on six major aspects of 

the project—list acquisition, the sample ./field staff recruiting, 

• j / 

training, the field work and verification pf field results. 



^-4*. 

B. Iliac Acquisition , - 

Detailed Phase I (Use acquisition) instructions and procedures were 
sent co the DSs on December 26, 1979 in Project Memorandum No. 13. In 
Year 11, ^dropouts were eligible for listing in Supplementary Frame sample 
/ schools if they were Born during che period 10/1/62 chrough 9/30/63 and 



* 



lef c school during ai^* one of che chree acadesic years 1977-78, 1978-79 
or; 1979-804 Sample schools with* a cvelfch grade were requested co list 
all students who graduated during che period January 1, 1978 co che dace 
of che f irsc day of Age Class 3 assessment in che PSU and who were also 
born during fee interval specified above M 



In most instances, permission co condupc Supplementary Frame ass ess - 
ment was obtained from the appropriate Age Class schopl officials when 



the DSs conducted their introductory, meetings, for their PSUs between m 
August 27 and October 5, 1979. At these v meetings the DSs provided the 
rationale for and the role of the schools in Supplementary Frame assess* 
ment. The DSs further explained that a final decision .as to whether the, 
Supplementary Frame project would be conducted was contingent upon the 
results of negotiations in progress to secure the^necessary funding 
for the assessment i During Age Class 1 assessment £h their PSUs, DSs 

y / ' " 

visited each Supplementary Frame sample school, provided them with- X 
detailed, printed instructions on ttfe proper completion of the dropout 
and graduate listing forms and provided each school with a supply of 
forms* Specific instructions were given schools to delay compilation of 
the lists until (he DSs notified the schools that a final go-ahead decision, 
had been reached, a decision expected by February 15 \ 1980. 



1/ In those schools graduating more than 250 students each year, eligible 
Sraduatea_were listed only if their surnames began with letters within 
alphabet sectors applied to a particular school. 
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The go-ahead decision was received at KTI during Che week of February 11; 

/ 7 

the DSs wtfte preoptic notified bf /the clecisiim and they, In turn, notified 



the appropriate school officials to proceed with compilation of the lists* 
, ^^Uurlng the period February 18 through -May 16, the lists were compiled, 
collected by DSs «and forwarded to STI* t 

Table 30 presents a final summary of Tear 11 Supplementary Frame 
list acquisition results, together with comparative data for years 54-07*. 
In Tear 11 Che percentage of sanple schools refusing Co provide dropout 

lists declined to 1.0Z, as compared to 5.7Z refusing in Tear 07* Likewise, 

* * * ■ 

the' percentage of Tear 11 sample schools refining to prov&e graduate 
lists declined as compared to the Tear 07 experience (1Z in Tear 11; 6.8Z 

In Tear 07)* Reversing a four-year trend of* declining percentages of 

* ■ * 

schools providing dropout list's, the Tear 11 figures shew an all-tj^p 

higti of 83. 3Z of sample schopls providing the lists* Moreover, an all- 

time high of 27. 3Z of sample schools provided graduate lists. 

C* The Sample 

In Tear 11 there were 32 PSUs where sample selection of potential 

* p * ( 

eligibles from graduate and/or dropout lists was possible* All sample 

Schools In one PSU reported having prior students meeting the study's 

birthdate and enrollment criteria. The sample of potential eligibles 

represented 160 of 162 replicd^es. A total sample of 1,096 potential 

i eligibles was selected, consisting of 965 dropouts and 131 gr^t^tes* 

, Approximately seven cases were allocated to each one-replicate PSU, 

fourteen to fifteen cases to each two-replicate PSU and twenty-one or 

, twenty- twp fcases to each three-replicate PSU. Of the 1,096 potential 

« ■ 

eligibles, it was expected th$t at least 55Z (603) would complete one 
or nor* packages. - 
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Table 30 . t 

* 

LIST ACQUISITION FINAX RESULTS FOR YEAR 11 DROPOUT AND TiffltLY GRADUATE 

SAMPLE SCHOOLS, WITH COMPARATIVE DATA FOR YEARS 04, OS, 06 AND 07 
• 9 





Yaar 11 


Year 07 


Year 06 


Year 


05 


Year 04 




No. 


Z 


No. 


Z 


No. 


Z 


No. 


Z 


No. 


Z 


1/ 

Age Class 3 Dropout Sasple Schools- 


209 


, 100.0 


230 


100.0 


• 429 


100.0* 


547 


100.0 


420 


* ■ 

100.0 


Refused or .Records Hot Available 


2 


1.0 


13 


5.7 


42 


9.8 


44 


8.0 


46 


nvo 


Responding Schools , 


207 


✓ 99,0 


217. 


94.3 


387 


90.2 


503 


92.0 


374 


89.0 


Responded "Ho Potential Eligibles" 






t * 


* 










a 




or "Ho Age-Ellglble. Dropouts"2/ 


33 


15.8 


65 


28.2 


91/* 


21.2 


109 


19.9 


50 


11.9 


Provided Dropout Lists 


174 


83.3 


152 


66.1 


296 


69.0 


394 


72.1 


324 


77.1 


Early Graduate Sample Schools ' 


205 


100.0 


205 


100.0 


395 ' 


100.0, 


511 


100.0 


*78 


100.0 * 


Refused' or Records Hot Available 


2 


1.0 


14 


6.8 


44 




- 43 


8.4 


71 


18.8 


Responding Schools 


203 


- 99.0 


191 


93.2 


*351 


88.9 


468 


91.6 


307 


81.2 


Responded "Ho Early Graduates" or "Ho 




* * 


■ * 














* 


Age-Eligible Graduate* vithip Alphabet; 










i 












Sectors''^/ « * . . " * ' 


147 


7i;7 


150 


73.2 


265 


67.1 


363 


71.0 


- 10 


2.6 


. Provided Graduate Lists 

* 


56 


27.3 


41 


20.0 


86 s 


21.8 


.10? 


20.5 


297 " 


, 78.6 



1/ 

- Does not Include regular assessment refusals or scfiools dropped f roa the sample due to g^adc 



/ * changes, closure,. nature of enrollment K etc* 



2/ 

-In Years 05, 06, 07 and 11* 
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^ " D, Field Staff Recruiting „ 

. . Generally, three factors were taken Into consideration in determining 
r the overall size of the Tear 11 Supplementary Frame field staff; (1) the 

number of DSs available, (2) the expectation that each Interviewer would 
resolve eight to tin cases per week, and (3) the convenience with which 
a geographically clustered case assignment coutd be arranged for each 

m , ■ 

. interviewer. Nine District Supervisors and eighteen temporary hourly 
personnel weret*etained -as interviewers. Most of thd latter group were 
individuals who had served as RTI interviewers previously and were rated 
as above average in carrying out their "past assignments. 

* E. Field ^taff Training 

» " i • 

Flans and arrangements for the Tear 11 Supplementary Frame draining 

sessions'were completed by central staff members in April and Kay 1980. 

t Also during that period, a detailed interviewer manual was prepared by 

RTX staff for use in training and as an in-fleld reference for the 

. interviewers. Three training sites (Raleigh, North Carolina; Hollywood, 

■ 

California; and St* Louis, Missouri) were selected that were convenient 
to the field .staff, and a training agenda was pxep3**4jyji-^bmitted to 
. NAZP for review* A copy of the agenda Unprovided in Appendix 
h * In preparation for the fieidwork, eleven interviewers attended the , 
session held at Raleigh, North Carolina on Kay 22-23; five interviewers 
attended the session "held at Hollywood, California on Kay 27*28; eleven 
interviewers attended the session held Ma^ ,29-30 at St. Louis, Missouri. 
The training sessions were conducted by Messrs* Smith and Fate* They 
were assisted in Raleigh and St. Louis by Mr. Bruce L. Jones, a 'member 
of the RTI Sampling Research and Design Center. An ECS/NAEP staff member 

* ; 

— also monitored each of the Raleigh and tibllywood sessions. 
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-F, — -Ini^yiewer Assignments - - 

The Year U Supplementary Frame assignments were constructed 
so that the nine DSs would carry most of tases requiring overnight 

travel an< that the 'other 18 interviewers generally would be £iv£n 

* * • 

work within daily awanuting distances of their* homes.. An Indi- 

vidual Screening Questionnarie (ISQ) was initiated for each of the 

1,096 sample individuals and all Interviewer assignment^ wgre prepared 

and sent to the field staff by June 2, 1980. The initial assign- 

✓ 

ments given the DSi averaged 67.4 c$ses, and the other 18 interviewers 
initially were giyen assignments averaging 25.7 cases* Some cases had 
to be reassigned to another intferviewer or an RTI central st^f f member 
in instances where it was determined that a sample individual had moved 
to a place that was outside the initial assignment area aqd the case 



could be followed up more ef ficientiy.by another member of the staff, 

L ■ 

G. Summary of Field Results 

Year 11 Supplementary Frame data collection .activities began on 



June 2, 1980 and were completed, aa scheduled, on July 31, 1980* 

Table 31 presents a preliminary summary o£ the results of Year U * 
Supplementary Frame fieldwork, together with comparative percentage 
results for Years 02 through 07* The *?ear 11 statistics shown in 
Table 31 may be subject to slight revisions when summary data tapes. from 
RTI and DataScore are reconciled ♦ * 

a * 

* I 

The comparative results Indicate that the performance of the Year 11 

Supplementary Frame field staff was^better than that of tha Year 07 

staff in determining the eligibility status of sample individuals and 

was equal to, that of the Year 07 interviewers in assessing those found 

# ■ 
to be eligible. In Year 07, the eligibility status of 12*7 percent of 




Table 31 

COMPARATIVE SUPPLEMENTARY FRAME FIELD 
(Years 02-07 > 11) 



No. of 
dropouts 



Year 11. % 



No* of early 
graduates 



Total 
No. j Percent 



R^^JLTS 



Year Q7 
Percent 



Year 06 
Percent 



Total Sample Indi-^ 
vlduals 



Individual's with un- 
determined eligi- 
bility status 

Refused to provide 
screening infor- 

4 matlon or uncoop- 
erative on 'all, 
callbacks 

Could not locate, or 
contact 
'Other 

Individuals deter- 
mined not eligible 

Ineligible birth- 
date or enrolled 
at assessment date 

Not U.S. resident , 
mentally or physi- 
cally incapably, , 
non-English speak- 
ing, or nonreader 

Other 

Individuals determined 
eligible 



965 



88 



-82 

237 
216 
21 



640 

p m 



13J 
4 



15 



11 



112 



1,096 100.0 100.0 
. 92 8.4 - 12.7 



.85 
252 

■ 

227 
25 



752 



0.6» • 



7.8 



23.0 



20.7 



2.3 



68.6 



1.7 



11.0 



18.7 



16.5 



2.3 



68.6 



12.2 



0.6 



Year 05 
Percent 



Year 04 
Percent 



Year 03 
Percent 



100.0 100.0 100.0 



13.3 14.3 



1.1 



1.3 



12.2 
27,0 $ 

* 

4 

24.4 



U\3 
0.3 

* 20.3 

17.1 

* 2.6 

0.5, 0.2 
67.5 59.7 



13.0 

31.6 
28/8 



2.4 2.4 

A. 



0.4 
54.0 



S 



100.0 
23.4 

1.7 

« » 

21.7 

25.5 
24.1 

0.3 
51.1 . 




Table 31 
(Continued)^ 

'comparative supplementary frame field results 



* * 


Year 11 






MS. of 
dropouts 


No. of early 
' graduates 


Total 
too. fPercent 


Year 07 
Percent 


Year 06 
Percent 


Year 05 
Percent 


Year 04 
Percent 


Year 03 
Percent 


Year 02 
Percent 



Refused to partlci- 45 
pate or uncoop- 
erative on all k 

& callbacks • 

Could dot contact 39 
or locate * \ 

», 

Other . , ' 

Package respondents 556- 



15 
4 



60 



5.5 



41 3.7 



* 651 59.4 




.59.5 



8.1 



3.5 ' 



0.5 
5S.5 



4.9 



2.9 



51.9 



3.2 



4.4 



"44.4 



9.4 



5.2 

V 

36.5 



9.T 



4.4 



36.1 



/ J 



Che sample could not be determined and 36*7 percent of those found to 

be eligible were assessed. The Year 11 preliminary statistics show 

the eligibility status of only 8*4 percent of the sample was not 

determined and«86.6 percent of those determined eligible became package 

respondents, 

♦ * 

H. Verification of Field Results 4 r — f 



■ * 
"Double nailer" postal cards and telephone calls were utilized, by 

thte Year 11 supervisory staff to verify that field procedures were 

properly carried out by the Supplementary. Frame interviewers* On th£ 

■ • * 
average, verification telephone calls were made to two package respondents 

per interviewer?"' One of the four /versions of the verification postal 

cards was mailed to virtually all of the remaining cases completed by 

each interviewer M Cards returri^L^containing information inconsistent 

with that on the corresponding XSQ wefe followed up by telephone and/or * 

additional correspondence * and corrective action was taken wjiere necessary. 

No major problems were detected in the course of the verification work 

and all detected inconsistencies were resolved* Examples of the four 

tyi?^t|fl£ cards are shown in 'Appendix G. p 

Table 32 provides a summary of the results of the Year 11 postal 

card and telephone verifications* A total of 949 verifications were 

attempted with postal cards,, with 388 responses received ap RTI. An 

additional AS telephone verifications ware made* All told, verifications 

-Kere attempted on 994, or 90»7%t of the Year 11 sample of 1,096 potential 

eligibles and w*re completed on 39*5 percent (433) of the total sample* 



1/ One version was sent to package respondents, one to thos^individuals 
determined to be ineligible, one to those individuals cljlsified as 
"could not locate", and one to refusals. 



Table 32 

YEAR 11 SUPPLEMEHTAEOr FRAME POSTAL CARD AND TELEPHONE VERIFICATIONS 





By Postal Card 


By Telephone 


Sent To 


No. • 
Sent 


No. 
Responding 


Z 

Responding 


No. Made 


§ 

Package Respondents 

i 


602 


273 


i 45.3 


45 


Ineligible Indi- 
viduals 


217 


81 


\ 37.3 


0 


"Could-Not-Locates" 


85 


21 


'24.7, 


0 


Refusals 


45 


13 


28.8 


_0 


"total 


949 


' 388 ' 


40.9 


45 „ 



V 



/ 
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V. NATIONAL ASSESSMENT MEETINGS AND FIELD TRIPS 



A. • Meetings — S 

Table 33 presents a summary of all major NAEP aeetlngs attended dur- 
ing the year ending ^May 31, 1980 by 8^1 in-school administration personnel. 
Of the five aeetlngs ^listed, four were NAEP Management Meetings. Minutes 

\ 

of each of these meetings were kept and copies have been sent tq the ECS/ 




NAEP staff involved, 
B» Field Trips 

Also i in the. twelve cfonths ending Majr 31, 1980, RTI field supervi- 
sory staff assigned to the in-school administration program took a*total 
of 105 field tjrips on Tear 11 project" business (see Table 34). A total of 
137 trips yfere taken by the RTI on-site personnel during the sacte months 
in 1978-1979. The decrease in *taf f travel from Year 10 to tear 11 was 



V 



due primarily to fewer trips being required Y» Year 11 for cexitral staff 
participate in introductory meetings, to assist or substitute for DSs 
in the conduct of assessment, and to hold special meetings with large- 
city and/or refusing districts • B 



9 
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■ • Table 33 

n a a- • 

NATIONAL ASSESSMENT MEETINGS ATTENDED BY RTI IN-SCHOOL STAFF 
* (June 1, 1979 - May 31, 1980) . 



1. Septenber 18-.19, 1979 

2. Decenber 4-5, 1979 

3. January 15^16, 1980 

4. March 4-5, 1980 

5. 4 April 1-3, 1980 



RTI 



EXI 
STI 



DataScore 



KAEP Management Meeting 

NAZP Management Meeting 

NAZP Management Meeting 

NAZP Management Meeting 
/ 

Supplementary Firame Conference 



r 
% 



if 



V 



/ 

/ 
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Table 34 4 

FIELD TRIPS TAKEN IN YEAR 11 BY RTI IN-SCHOOL' FIELD 
■ * ' SUPERVISORY STAFF 

(June 1, 1979 - May 31, 1980). 



Nuaber Of 
Trips Taken 

» * 

1. Conduct quality check ~ ™ * 39 V 

2 - Jtoutine field visits with^DSs 17 

t 3. Conduct, observe, or assist with 11 
_ ^introductory oeetings 

4. Assist DS with assessment 'or conduct n 
assessment alofte 

5. Special visits with large city and/or 10—' 
refusing school districts 

v 

^ 6* Train/assist/obserye* new DSs in their 9 
^ first week of assessment 

7. Recruit replacements DSs , - 4 

8. Supplementary Frame training sessions 2 

9. * Supplementary Frame planning conference - 1 

10* Review completed packages and check-in 1 

procednres at DataScore 

TOTALS ' / * J 105 



1/ DS field visits also were made on two of these trips. 
2/ Recruitings also was done on twi of these trips. 
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VI. INVENTORY OF NAEP MATERIALS AND EQUIPMENT 

* • * « 

By old-August all nonexpendable materials and equipment used by In- 

school District Supervisors and by Supplementary Frame field interviewers 

9 

had been returned to RII«. By the end of August, 1980 > a comprehensive 

inventory was taken of all NAEP materials and equipment stored at RII's 

an -camp us warehouse. This comprehensive inventory was taken aftfer NAEP 

acfa RII staff Identified" for removal from inventory certain stimulus 

materials which are not to be used in future assessments* 

Appendix H contains the inventory stored at RTI on August 29, 1980* 

The inventory includes stimulus materials used in previous assessment 

» ♦ 

years and equipment and unused materials from Year 11 tod previous assess- 

« * * 

ment years* 
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VII. EXPENDITURES OF FUNDS AND. EFFORT 

At Funds K * - 

- t „ 

Table 35 presents a by-project suaoary of estimated Year 11 booked 

4 

coses through May 31, 19$0 taken fron RTI cost reports for RTI Project 
Huabers 253U-1769 and 2S3U-1973 covering Year 11 in-school administration, 
in the period\fron June 1, 1979 through May 31, 1980. Project 253U-1769 
covered calendar year 1979 operations; and project 25 3U-1973 was established 
to cover adninistration activities in calendar year 1980. Only those costs 
booked on 253U-1769 between June 1, T.979 and 6ei£enber 31, 1979 and on 253U- 
_1973 during the first five aonths of 1980 ver<f considered Year 11 costs. 

Total Tear 11 booked costs were estiaatdl to total $978,385. Of that 
aaount 52. 7Z (S515,08lJ was associated with/ff-site expenditures for DS 
salar^s and* traveland EA. services and otl^er* costs. ' In Tear 10, total 
costs we're estimated "to lie "$944, 086, of which 51. 8Z was spent on off-site 
activities. 

S. Effort v ^ " 

During Year 11, a total 34,820.5 person-Jiours of effort was devoted 
to the planning and conduct of in-school assessment <see Table 36); in 
Year 10, 36,033 gersqn-hours were expended to codpiece in-school adainis- , 
tratlon assignaents. The decrease in effort fron Year 10 to Year 11 was 
due priaarily to less on-sibe professional labor .being ^required in Year 
11 to juperyjfoe £he field operations* - — ■ 
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Table 35 

EXPENDITURES OF NAEF FUNDS ON TEAR 11 
IN-SpEOOL ADMINISTRATION 





RTI 
Project 
253U-1769 


RTI 
." Proj ect 
253U-1973 


Total For 
Year 11 




On-Site Costs 


$279,241 


$184,063 

• * 


$463,304 


• 


• 

Off-Site Costs 


■253, 341 


261.740 


' ' 515,081 




Total 4 " 


$532,582 


$445,803 


$978,385 




- 




» 

/ 

% 


♦ 

• 


■ 


• 






* 


• 


PERSON-HOURS 


Table 36 

CHARGED TO IN-SCHOOL ADMINISTRATION . 
(Years 08 - 11) • 


\ • 

f 


* 

■ { 
On-Site: 


6/-1/76- * 
5/31/77 


. 6/1/77- 
5/31/78 


* 

6/1/78- 
■ 5/31/79- • 


6/1/79- 
5/31/80 


Professional 


10,294.75 _ 


9,129.25 


9,530:00 


8,897.75 


Support N v ' 


5,623.25 


5,602.25 


5,755.45 


>,366.75 


Off-Sise; 


• 




m 




District Supervisors 


16,860.00 


18,579.25 


t 

20,753.00 


20X556.00 
34,820.50 


Total" 


32,778.00 


33,310.75 


36,038.45 




\ 




DISTRICT SUPERVISOR TRAINING SESSION 
YEAR 11 

m 

JULY 30, 19?9 - AUGUST 2, 1979 • 



NATIONAL ASSESSMENT < 

■ 

OF 

EDUCATIONAL PROGRESS 
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AGENDA • 



■ 0 



R 



-T 
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.Monday, July 30, 1070 
HT£ Hill Building, Room 101 



8:30 a.m.. Welcome and Introductions 
RTI Tour 

10:45 a.m. Break ^ 

11:00 a.m. Year 11 Assessment Schedule 

*11:30 a.m. Lunch . * * 

1:00 p.m. Telepiione Calls .tp* School 
Officials 

2:15* p.m. Simulated Telephone Calls' 

3:00 ptm. Break ^ 

3: IS p.m. , Compietion of 4 RTI Personnel 
Forms * # 



W. Gvogan 
D: Scott 



D. Smith 

D. Smith 
' D. SmitJ} 



McDonald 
• 'Williams % 

to 



80 



'lhettday, July 31, 1979 
Hrr Hill Building, Room 10 1 



8:30 a.m. Student Sample Selection ^ K* Pate 
. Procedures j 

10:30 a.m. ^ Break > < 

10;4S a.m. Introductory Meeting? with . , A. Duffer 
Softool Officials 

^>on Lunch 

1:00 p.m. Supplementary Frame D. Smith 

* Assessment % f 

1:30 p.m. Simulated Introductory 'A. Duffer 

■ b ^Meeting 

2:30 p.m. Break 

2:45 'p.m. Package Administration 'i Ruso 

Procedures 

4:00 p.m. Primary* Sampling Unit r v /?- Ry&& 

Planning and Scheduling 



< 1 



* 0 



V 



J 



Uedbieoday, Augur, t l 9 1079 
KT£ Hill building Board Room (Uixth Floor) " 

. Kefcencw District Supervisors* 



w 9:00 a.m. 

11:30 a.m. 
1:00 p.m. 

* * 1:3ft ) p.m. 
* 2:u0 p.m. 



Welcome 
RTI Tour 

•» * 

' Lunch 



* J/.. Grogan 



Introduction and Welcome 
(all DSsr) • • * 



Year JO Results 

Year 11 Procedural Changes 
and Areas for &nphasis 



2:45 p.m. Brmk . 



' W. Grogan ] 
*V. 'Chro/rrj 

D.^nith 

K. Pate 
D. SmutJt 



3;00 p.m. ' Student Sample Selection . . - K. Pale U 
, % * Procedure^ _ , 

4:25 p.m. ^Rpgiortpl ^Supervisor Meetings' A. Duffer 

I Distribution, o /; Assignments) K. Pate 
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Wednesday, August 1, 1079 & 
Hew District Supervisory 



8:30 a.m. 

11:30 a.m. 
1{00 p.m. 



Example Group Package Admini- 
s tra Hon 

Lunch 



K. Pate 
R. Rues 



Introduction and Welcome W. Grogan 

(All DSs) (RTI Hill Building J. Chromij 
Board Room-Sixth Floor) 



1:30 p.m. 

C { .2:00 p.m.' 

2:4S p.m. 
, 3:00 p.m. 

3:30 p*m.* 
4:00 p.m. 



RTI Hill Building, Room 101 

Hiring, Training, and Super* 
vising EAs . 

Completion *of Administrative 
Forms / - " 

Break * 

"Measurement Research Center: 
Printing and Scoring 

Tests and Measurements 



<A. Duffer 



R. 



Rues % £ 



S. Worthen 



C. 



SteifensQn 

Simnary of OS Responsibilities , A. Duffer 



4:1$ p.m. Regional Supervisor Meetings* A. 

(Distribution of Assignments) \ K, 



Duffer 
Pate > 
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'Thursday, August 2, 1979 
RTI Hill -building Board Room ($ixth Floor) 



8:30 a.m. 



NAEP Presentation 



9:00 a.m. National Institute of 
> Educa tion 

■ 

9:30 a.m. * NA£P Field "Services 



10:00 a.m. 
10:15 a.m. 
■ ■ 

10:30 a.m. 
10:45 a.m. 



Br$ak 
§ 

Heading and Literature 
seosment 



Supplementary Principal's . 
Questionnaire 

Regional Supervisor's $ 
Meetings 

* * 

* 

* * 



G. Frwzier 
M. Milvod 

m 

G. Fvaziev 

•N. Mead 
K. Pate 



A. Duffer 
K. Pate 



as 




v. • 
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. * E-1 * Age Cla^s 2 

f ' ' NATIONAL ASSESSMENT 

I « 

Receiving Specifications 




TERMS 

- '/ * 

PSU ■ Primary Sampl i hg Unit = A PSU is a 2 digit number iwhich identifies 

the geographical location of the sample. 

OS ,» District Supervisor • = The country is divided into 13 parts. A 

,district supervisor is assigned to each part. 

EA 3 Exercise Administrator = EA's are hired by a DS to administer the test. 

RTI = * Research Triangle Institute = Located in Research Triangle Park, North 

\ Carolina {center of. a triangle formed by 

the cities of Raleigh, Durham, and Chapel 
Hill). RTI is the NAEP subcontractor 
responsible for sampling and " 

; * administration. . ^ 

RECEIVING. PROCEDURES ' 

* b 

1) Hardshells for approximately 10 PSU's wiU be received by bus each week. 
-These may be complete or partial* PSU shipments. 

2) When stock control delivers the hardshells they will notify the person in 
_ charge of NAEP Receiving. 

3) * the person in charge of NAEP Receiving will enteV the date and number of 

- -4*a^h€l4*^receivsd on the jtecew^Check-Ust. -{See Attachme nt 1.) — =Fh« — v 
checklist nxjst bg kept current. 

4) OS's shoyld have writtan the PS& number on the top of the hardshell* Enter 
this number on the checklist. , If the PSU number is not written on the 
return card, open the hardshell to find the number and enter it on the csrd. 

*«5) The hardshells recejved^shouj^ be stacked by PSU and'set a$ide^fOF opening. 

* * 

RTI IHCOHIHG' FORMS « , 
* — 1 ■ 'v _ 

Group Administration Schedule Forms {yellow tear-off s)*' 

Identifies grade, sex, birthdate, and, race for each ID/package/school PSU. 
This. is a yellow strip of paper or tear-off. " 

Hardshell Cover Sheet.* ' v * 

■Inventory of "the quantities of each package sent for a given hardshell. 
'{"See Attachment 2.) , 



' ERIC . : • S3 

" •' '. * . . ' * • \ 



-Package Assignment Summary » , 

Lists the schools included i'n, each PSU. A ranae of packages are also listed 
.for Bach school . {See Attachment 3.) 

s 

School Worksheet » . < - 

Inventories the packages and their quantities tested' in the school. 
Administration problems are written in the section at the bottom of the i 
*. page. {See Attachment 4.) *. . ' - . • 

v. 

DATASCORE OPEKIHG FORMS 

Problem Tally Sheet = 

Describes certain errors committed by a DS in returning the" hardshel 1 . fSee 
Attachement 5.) 1 

» - 

School Header = 

V Identification Header for DataScor* processing. ISee Attachment 6.) . , . 
. \. i \\ - . . ! M * I *• Mffil \ * si \ * H 1 1 « 
School Itorksheet Tallj^ * y,A ***'?\ ij' ' f ' ' J 'f'l j ' '! 
Inventories the number Jbf each package for each school. {See Attachment - 
\ * * _ .j 

Condition CodeiLog * . ! 

ldentifie~/and describes problems in administration. (See Attachment 11.)* - j 

OPENIHG PROCEDURES / ^ - ' ; 

1) Choose a PSU. Be sure to pull all the hardshel Is which are present for .that 
PSU. Chdose those PSU'S in x)rder of receipt. 



2) Pull the Package Assignment Summary for the PSU. {See Attachment 3.} 

* — j 

3) Start Condition Code Logs - one condition code log wiM be used for each v 
package number. (See Attachment 11.) ' 

1 

4) Start a Problem Tally Sheet. ' * . . 

5) Open the first hardshell of the PSU. Refer to the^cWt' for the contents 
*nd order of an unopened PSU (see Attachment 1): Each hardshell should con- 
tain a hardshell cover sJieet.rTake out the hardshell cover sheet and' set it 

. aside. If a cover sheet was not enclosed, enter an error on the Problem 
Tally Sheet. Fill out a cover sheet for the hardshell. 

6) The next document in the hardshell should be a school worksheet. Read Sec- 
tion F to alert you to admijni strati on problems which you will encounter 
later in the hardglieil. CHeck to make sure there is a "Final Group Size" 
listed on the woroheet. J ■ 1 

A} A Principals' Questidnhaire should be enclosed for each school. If the 
appropriate PQ 1s not enclosed, the DS should have written a note J 



* - 



E - 3 - , •. "* ^ 



. explaining when it will be transmitted. (If no note is present, mark 
and ernpr c^he Problem Tally.) 

B) Make sure the PSU/Schcol number is entered and gridde^. 

C) File the PQ(s) in- PSU/School order. , • - 

* * • * 

0) ir,.^® L ?Q f s) w111 be comin 9 later » insert a'shee/*of goTTpaper. with tire 
PSU/School__number Written on it. When the PQ comes in take out the gold 



sheet. . 



7). The Group Administration Schedules (GAS's) should follow the worksheet. In 
some cases the GAS's will be -tucked inside the first package of each package 
set. Se£ them aside. * • & s+ ' 



8) The package sets for that school sttould follow the GAS"s. EacV-set of- 
. packages should already be turned in the hardshell. . H/" 

9) J fie .but the fWt set of packages. Ihe PSU and school numbers are written 
,¥ 2?,. t ^%I ron ' t ^ each ' ,packa9e " Section # 8 - The first two entries are the 
• C oc last three entries are tne school > number. Be su<T,that you, have 

the PSU and school to match the school worksheet you are working with. 'Make 
. sure all the packages in one set are the same package- number. 

" * ' * t . > 

10) Count the packages in each- package set 4 and check off that distinct package 
\ number on the School Worksheet with a red pen. !f^he counts do not match, 

- check the GAS for that package set. If the GAS agrees with your-count, ' 
change the School Worksheet in red and enter an error on the Tally Sheet. 
If the GAS does not agree.with yoW counts-see the Receiving Coordinator. 

11) Check the information from the GAS to the^front of^ ach package- Section 3,6. 
.Find the GAS for that package number. , 

v . • . y 

> B) Check to make sure tne same PSU and school number is written on the GAS 
school worksheet and EACH package. . 

C) Find the ID number on the GAS that corresponds with the ID on the 
package. « \ 

H — 

DJ Check the* data entered in' Sections 3-6 on the cover of the package. 

1) Column- 3 « Grade , _., \>. . ' 
98 a Ungraded Class * 

99. 'Special Education '. y ' . • ■ . - 

' \ ' - «. ' - ; - - . » 

2) Column 4 * Sex , • 
' 1 ■ M,ale ' 1 ♦ 

2 » Female . , 



olumn 5 * Birthdate 

TT7ear olds * 01-12, 1966. ' , 
Hake sure the year is in range. If npt, the student is not eli- 
* gibl,e. (See Section 12'd,.) • * 

. ' 4) Column 6 =■ Race ' 

1 = White ■ . ' 
• 2 = BlaCk . ' , 

3 = Spanish Heritage 1 

4 - American Indian or Alaskan Native i 
5,-= Asian or Pacific Islander *' ■ 

6 * Other «V , 

« ^- 

E) If you find a discrepancy between the yellow GAS tear-offs and the cover 

entries/' change the. entry on the package. Enter an error on the Problem 
Tally. 

« * * 

12) Check to' see that one oval is gridded m the Package Wide Condition tode 
(PCO). The PCO is located in the lower left corner of the cover page. The 
ovaTs are marked N N (normal), P (partial), NR {no response), and NE (not- 
eligible). 



A) When the PCO. is fn ft, this means that the administration was normal. 

• ' ■ ' - »* - 

B) If the PCO is a 'P, there should'be a note from th,e OS either on the 

. package or worksheet explaining why the administration was partial and\^ 
"which items' were not completed. If this note* 'is only on the worksheet, 
transfer fjt to the front of the' package and enter an error on the • 
Problem Tally Sheet. « . " 

,1) Enter the ID and note th*e condition code log for ^^hat-package. 

* 2) If there is no note, consult the Recei-ving Coordinator to. resolve* 
the problem. If you rou*t change the P to N, enter an esror on the 
Taj ly Sheet. * ■ 

0)^ If the. PCO. is an,NR: < . . ' 

1) All items roust be no response. 

2) "If any iten has been responded to, check the eligibility of the Stu- 
dent and change the NR to N or NE, (see J) belcw) and enter*an error 

. on the Tally, Sheet. *C - . * 

* * * 

0) If ihe PCO is an NE; ' « 

1) The OS should have written the problem on the front of the package. 

2) .When no note is written, look, for the problem. 

f a. Look at the birthdate on the GAS to &e if it is out of range 

. (OOR). . * 

b. Consult the Receiving Coordinator for assistance in resolving 
the^problem. * % 



c) If no note is written on the package or worksheet, mark an error 

> on the Tally Sheet* 

*<1) *Write a note on the front of. the package (if no note is written) 

\ explaining why the package has been deleted, 

3) Pull the package out of .the assessment* 

4) Mak"e sure the PSlf and school numbers written on the front of 'tjie 

s package are correct, , 
*« - • • 

5) T Correct the package codnt on the school worksheet, unless- the DS has . / 
'already done so. The Hardshell Cover Sheet count should INCLUDE the m 

* deleted package. * 

6\ On tire school worksheet, make a note of the ID number, package 
'.number and^the reason fctf-deTeting the pa^Jcage.^ - ^ 

Background questions are on the tailsheet of eash package/ (See Attachment 8.) 

A) A school may refuse to have the students answer these questions, 

* 1 The DS must write a memo or make a riote on the school worksheet, k 

ZY If there is no note, check the list of school refus-als which was 
$ sent by RTI. * ' . . . 

3) Notify the Receiving Coordinator of any refusals which are not on 

• « ' ' 

B) If any of all ,of questions 1-9 (tfn the back page) are blank, code the 
1DK oval. If any or 'all of- 5-9 are blank,- enter an error on the 
Rroblem Ja-Uy sheet. 

C) Questidn 9 asks in which states the student lived on his/her 9th 
tfi rthday. 

10 "^V* "In the U.S,", check the following,- t * 

a) See t;hat the oval is gridded in the proper part, A state should 
be written in the' proper blank, ' 

b) Grid, the state code in the column at the right, (See Attachment 
8 and 90 

c) If a territory is written,, chect-the list of U.S, territories in 



Attachment 9, A 
1) ( If the territory is listed, grid "QT 
right. * # 



in the column at the 



2) If the, territory is not listed as a recognized territory, 
1 check with the Receiving Coordinator, 
d) If a city is written on the Vine:" ♦ t 

1) See' if that city has been listed in conjunction with a state 
name on other packages in that school. If so, code that 



state. If. not, look in an atlas to see if a city by that 
name exists in the state in whjch the school is located 
(found on Package Assignment Summary ). ' , 
* 2) .Enter air error on the Tally Sheet. *- ' 
e) If the line is blankV- . v - 

1) Grid the oyal labeled BL (3rd from the bottom), . 
■2) Enter an error on the Tally Sheet. 

If "Outside the U.*S.\ check th% following. ' 1 '.* « 

a) See that the oval is gridded in the proper part. 

b) A country should be written on the line. If so, code "QC" .in 
the column on the right. • > 

• c) If the Vine is blank, code £1 (at the bottom of the page) and ' 
enter an error on the Tally Sheet. . 

3J- If IDK is grfdded, do not code anything in the column on the* right. 

14) When you have finished a set of packages, complete a school header. There 
will be header for each package set. Enter the following "information. (See 
Attachment 6.) - \ 

* 

t A) 2-digit ^SU. 

• * 

8) 3-digit school. • /-r^ 

C) t^NT — total number 'of p v acteges (3 digits'). ' ' 

D) iNu'mber of packages — enter only counts for 'that j)ar.ticular package set. 

15) . The packages are'now ready for a preliminary handscoring phase. At this 

time, enter-and grid.all embedded IO's, handscore the clerical scoring 
items, condition. code any affected items and check' to make sure the inserts 
have been removed from the packages. A list of inserts and their locations 
follows. . \ 



* - ■ ■ » Age Class II Inserts ' 

MnWt # Insert-Description Package *■ , item # ! Page f 

i Dictionary Page £ 7. 14-15 * r 

plot/plunge (IP.) > 

2' Table of Contents (4 pp.) 11 . 7* 16-1 7 ,# 

v - 3 ' Bridges. (4 pp<) • 12 , ' 5 * / 8-9 

.4 . ♦ Index - Conquistadores/ 12 8 24-25. 

Education "(1 p.) "* » 

" . .5 . / Dictionary* Page -13 N * 5 14-15 
' H/haet (1 p'.) 

■ * 

* . » 

16) Place* the package* set in a cardboard box. Each package number is boxed 
separately. For example ^there will be a box of. package' l's, a box of 
package 2's, etc. One bo* will contain several PSU's. The PSU/School must 

• . be kept together under the school header. Turn each' school in the box. 

» 

17) Repeat steps 1 to 16 for. all package sets in the school., 



18) At the completion of a school, be'sure you have accounted for all the pack- 
ages listed on the school worksheet. 

* ♦ 

*19) Usihg the school worksheet, -check off the school on the Package Assignment 
Summary. Also make sure that tfte packages assigned to that school hav6^b>efi 
tested. Notify the Receiving Coordinator if there are any discrepancies. 
. If there were no packages to be administered in a school, write "NN" by the' 
school number. • ' 

' ■' ' . 

20) Again using the school worksheet, check off the number of; packages returned* ' 
against the quantttites listed on 'the hardshell cover sheet. * Make^our 
corrections ^in red an T d enter .an error on 'the Problem Tally. 

21) . If there are any problems which can't be-solved without calling RTI, fill 

out a Receiving Problem Sheet. Turn this in to the Receiving Coordinator • 
with the other forms when you have completed the PSUl 

22) Repeat steps.l to 21 for each school in the PSU.' • » 

'/ - v *' ' 

23) If the- PSU is complete, check "complete" ori the Problem Tally. If the^PSU 

is not complete, check "partial 1 " on the Problem Ta I Ty.^ # * • * 

24) Xerox 2 copies of the Problem Tally Sheet. Xerox 1 copy of the School 
Worksheet if any changes have been made. Xerox 1 copy of the Hardshell 
Cover Sheet if any'chagnes have been -made. * s 

25) At the completion of a PSU,- paperclip the fallowing together*: 

A) Package ^Assignment Summary 

B) Hardshell Cover Sheets - ' v „ 

C) School Worksheets ■ ' , " 

0) Problem Tally Sheet ' ' • - 

E) Deleted Packages 

■ ■ * 

F) Xeroxes ' * ■ , 

Turn the finished forms in to the Receiving Coordinator." A ; 

26) Separate the GAS's by package. Ffle them by PSU /Schools - " , 

27) The keypunch form, "National Assessm*t School Worksheets," will be filled out 
by the Receiving Coordinator. (See Attachment 10) / 4 
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Receivers should initial (inured) a shipment after it is, opened. 



OS 



PSU 



Hardsell Covw'Shfwt, 
Yeor tt kgo Class 2 ^ 



• , X- 



Packages 
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erIc, 



• OfroctloAS* 



> >•< f £nclosa o hardshall dovar shaat In <*>ch hardshall (box) of tho PSU., 
2, Entar «ch school nupbar Included In tha hardshell. 



Aw 'En tor tha quant It lasyof tha packago* assassa<( In aach school. 
M^* Total 1ha column for odch* packago contalnad In tha hardshall. 

Dtspopttlont Whlto copy to MRC;- yatlc* copy ratalnad by OS. 



07/30^9 
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£-12 * 
YEAR '11 1 
RECEIVING 'PROBLEM TALLY 
Age .Class, 2 
- y " 



, Partial' 
Complete 



P.S.U. 



: ; 


E.« A'. No., 


< * 

. * • 

3» P^ckaQe Counts *lnrnrrprf * * * 


i 1 


A 


• 


9 


k 






b. Worksheet not returned rT> 














1 


d. Miscellaneous , A • ' 








• • * / •• • 

.2. Supplementary Principal's Questionnaire 

• • 


* » \ 

4 










" ■ V 

, •> o. i „ Background questions (tailsheet) 

* 

/ . <j. questions o-y gridded wnert specifically not 

\ * • allowed by school 








t 


^ ft 
* 

■: • b.. Questions 5-9 not answered and- no explanation 


• 






* • * * * 

■ % 

i > » 








*** • 

* 

d. Question 9 - in U.S. - ^ntry Is other than a \ 








e. Miscellaneous r * 




1 




• 4. .Package Condition Ovals' (PC0)«- 












k 


• 

u- NR Or NP Qrfrlrlprl hipf nn flvnl an^r inn «n ni/«I/«nA 


1 






• * • • 

y / • c. P gridded but no explanation-reason and affiled 
exercise(s) noted tan front of package..-.. 








♦ 

d.. N gridded, but administration is partial 




* 




e.' BDf is out of range, but PCO not coded as NE 








f. Miscellaneous 
o 
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* 5. Group Administration Schedule Forms ffearoffr) 

• » * * „ • 

a. Not returned t * # * ##< 

•b. Returned but incomplete or not legible."..., 



1* Grade 

4 ' 2. .5t>x....' 

^ P 8irthdate 

4. Race 

5. ' * P^/Scbool Number 



- c. Entries transferred incorrectly to front of 

- package .V 

T. Grade 

2. Sex.. ; 

3. Birthdate : 1 

4. Race 

' i * 

% ■ i 

^ 5. PSU/SchoorNumber 

d. ID written incorrectly on GAS ■ 

e. Miscellaneous # 

6. * Miscellaneous * 

incorrect packages administered v ..., 

b, ^Hardshell incorrectly packed * 

• ■ . * i • 

1. Schools are interspersed and not packed as 
cohesive units. 

^ 2# Within the school unit, package numbers are - 
* mixed together. For example, Package 1 1 s 
and 2's are interspersed. 

• p c. Cover'sheet filled t out incorrectly or not-/ > 
hetyrned;.... 

d> .*0ther miscellaneous " p % 

/ , ; — 

* m : 

/ 



i * i 



• 
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Other Information 
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PACKAGES 



P.S,U. 






/ • 



Contents and Order of an Unopened PSU 



J 




■ * The number and order may 
vary slightly from DS to DS. 
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•Y 

czi^Yes 



No' CD 1 doa't kpojj* 

v 



E-16 



Does your family get any magazines regularly? 

> • 

■dp 'Yes CD No CD I don't know. 
.Are there niofp^han 2{3 books in your home? . 



Yes 



'No 



" 1 



I don't "know. 



Is there an encyclopedia in your home?. 
CD Yes CD flo ■ CD I don*l knofr. 



• How much school did your father cqftplete? * \ 

(FILL INJJiE ONE OVAL jvhiclj best shows how much school your 
"father completed.) ^ ■ 

* CD Did riot complete the* 8th grade /" 
; CD Completed the 8th grade, but did not go to high scfiooHR 

CD Went to high school, but did not graduate from high school * , 
y CD. Graduated frfyn high ^school - > 
CD Some edi/cati^'after'graduatioi^ftom hi^choof - * 



I dfcn't know. 



Did your father graduate from a college or university? 



5 Yes^ 



No 



I don't know 
t 



or unn 



How much school did your *mother,complete? 
(FILL IN THE ONE OVAL which beft shows how much school your 
mother completed.) . * */ 

CD Jpid^ot compete thf8th'grad£ V ' 
^/ Completed the 8th grade.' but 'dicOiot go to high schod 

Went to high school but did nodftaduate from high sch?ol 
4 — : Graduate^ from high school - * > 

Some' education after graSu^tion from frighschoo! ; • 




CJ> jTdon't know. 

Did yojir mother graduate from a college or university' 



Yes 



No 



"I don't know. 



Where did you jive oh yo'ur ninth birthday?* • 

CD In the^Jnited States (Please specify the state or territory.^ 



J- 



^Outside the United States (Please sp.ecify the cpuntry^^ 



Tdon'tlcnow. 
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• 41 -co cd 
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f ni < — 
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try , — , 
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MJJ£_D 
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MA CD 






*>* 






Mo C^D 








Ml ^D 
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IV d CD 




NV C_) 








i\J CD 




INM CD 
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NATIONAL ASSES .SHE NT OF EDUCATIONAL PROGRESS ' ' 

Supplementary Frane Assessoent 
... May 1980 



TRAINING AGENDA 



« 



*First Day '* . . 

9:00 a.m." Introductions and General Comments 

* 

9:30 a.m. % Supplementary Frame Assessment N 

1. What is it? ] , 

2. What arejthe objectives? 
t 3. Why is it neqessary? 

9jc45 a?m. Break * 

10; 00 a.m. Definition of Terms 4 

10:15 a.m.* Supplies an4 Equipment 

- 1* Individual Screening Questionnaires 
2. Paqkage Envelopes 
3* Cassette T4£e Recorders and Tapes 
^ J 4 # Reporting Forms 

m - 

11:00 a.m. Locating the Selected Individuals 

1. m Why is this vital? . f 

2. ^AcefegtancCof Eligibility Information 
* - * 3. Suggested Procedures . ■ "~~ 

4,, Verification of Field Work 
/ 1 - . ... 

Npon • Lunch T 

1:15 p.m. Indiyidual Screening Questionnaire 1 

l,t Organizing Your Work 
' Z. Identifying Information "(Part X) 

* / 3. Field Procedures (Part II) 

* 4. Eligibility^ Information (Part III) 
* - T 5. Sesulta of Field Procedures (Part IV) 

^ -t 
2:15 pla. Background Questionnaire and PacWge Administration Procedures 

-** , 1. Package Assignment L^bel 

„ 2* ^ Respondent's Compensation 

3. Use. of thejiape Recorder and Tapes, 

' * 4. Administering Packages and v 5upplenents 

3:30 p. a. Break. * ' 

3;'45 p.m. Coding and Grinding Completed Documents 

■ 

4:15* p.m. • Questions *and Answers * \ 
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ERLC 




* % * 

* *■ 



Second Day ■ J 

9:00 a. my f Administrative Procedures , 

' , 1. „ Returning Completed Work , 

2. Itineraries \ 

3, Producti'cm ReporW 

4» Travel ' \ * 

5. * Reporting Time ^nd- Expenses 



,0:15 a.m. 



7 



10:li a.m. ' Break 1 f * 

10:30 a.m., ^ Interviewing Techniques » 

"l s Establishing Rapport 
2. Obtaining Cooperation* - 
^ 3. Converting Refusals 

V 

11:15 a.m. Questions and -Answers 

11:30 a.m. Meeting with Immediate Supervisor 
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VERIFICATION OF PACKAGE RESPONDENT 



NATIONAL ASSESSMENT OF. EDUCATIONAL PROGRESS 

i 



Diar 



Our records indicace chac on 

completed booklets of ^ 

administered by\ 



you 



questions 



in connection 



with the National Assessment of Educational Progress. 

We are bringing our records^ up to date and would appreciate 
your assistance. Please ££tach this card, complete the other 
>card, and mail it as soon as possible/ No postage is % 
necessary. Thank yqu for yotir h*lp. 

Cordially, 



Donald G. Smith 
Project Leader 



?es 



booklets. Did 
No 



, Thi noon k m\t«xU* by Uw (20 U.S.C. 1221 c-M. Wh3« 
you «rt not rmtod to rwpoodi your toopwioo kmrtid 
to m«kt tfit r&itt* of thU ftuvty comprvhtntivt, •ecvrttt % 
jndtknWy. ^ * 

. VsU No. Individual No. ; 

Our records indicate that you completed 

you cqmplete that number of booklets? ^ 

Why was the total time required to coipplete aUL tfie booklets? 

Was a tape recorder used to administer jthe* booklets? " , - 

Tea 1 N o ^ '* / /""^^V 

Was the interviewer present the entire time? Y es - , N o 
'Wexfe you paid .to complete t^he booklets? / Y es ■ N o 

What is' your birthdate? \ , 

t Were you enrolled in schdol durin'g Marc)4.^r : Aoril, 1980? 
v tea 



_No 
Signed: 

HIE Form No* 2388-3 



• ( 
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VERIFICATION OF INELIGIBLE 



X 



NATIONAL ASSESSMENT OF- EDUCATIONAL PRQGRESS v ' 
Dear • * > 

; — \ 

We are bringing our records ,up to date and, would 
appreciate your assistance. Please detach this card, 
complete the other card) and mail* it as soon as 'possible* 
No -postage is necessary, thank you n% f,or your help* 

4 

-Cordially) 



Donald G. Smith 
Project Leader ' 



Thk rtoort* */thcrixtd by l*w 1» 1221 c.l£Wh«« v ' 

YOJ «t not noutrtd to mpornf. your coop«m(cn it * No. 05t-Rlli< 

to m«* tt>« multt o* t^iurvty compf*»u*vt. aecuntt, Apfw* 6«pSr«*3G/d 

•ndUmWy. 

,PSU No. - Individual^, ; ; m % 

You were recently contacted regarding the participation of 

* in the National Assessment 

of Educational Progress* < • . 

Whatr is (his/her) bixthdate? ; p ^ 

i* ^4* (he/she) enroled in^pVi^ate or public elementary >pr 
" high school i ^Mffrch or 'April. 1980? 

' Y es - m * , \ 

Signed: * * , ^ ■ 



IT YOU WBRH.NOT CONTACTED CONCERNING THE INDIVIDUAL NAMED, 
PLEASE CHECK HERE; \ 



ME Fora Mo. 2388-4 
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VERIFICATION OF REFUSAL 



NATIONAL ASSESSMENT OF EDUCATIONAL PROGRESS 



• Dear 



Me are bringing our records up to date and would appreciate 
your assistance. Please detach this car<l, conplete the 
mother card, and mail it as soon *s possible. No postage is 
necessary 1 Thank you for your help. ' ^ 



Cordially, 

■ 

Donald G. Smith 
Project Leader K 



/ 



OJU.B.No.05,1-R-12<H \ 
Approvil Expiry 9/30/&1 



This noon H «uthori2«d by law (20 U.5.C. 1231 c-Jl mtli 
you trt not rtqulrtd to rnpood # your cocp#rttlon it nttdtd 

to mtk4 tht rwultt of this Mtv+f eomprrfwrwivf . *ceuritt. ¥ , . 

tfldtkW / ^ , ^ , Individual No. 

PSU ^0/ / ^ . - _ 

Our records indicate you were Recently contacted by 
our F^eld Interviewer 



xegarding your participation in the National Assessment ot 
Educational progress/ Please check the appropriate box below, 

* ' * •> * 

I I I was contacted but ditknot participate. 
r 0 

\ 1 I wad not contacted. ^ 



v 



HIE Form No. iT/tlrlS 



Signed: 
/ » ■ 



1.1? 



. .1 



^ VERIFICATION OF COULD NOT LOCATE ' ■ ' 



Rational assessment of^educational progress 



Dear • J 

* s> ' • 

\ • We are bringing our records up tp*<iat« and would 
appreciate your assistance. PIeas6,4e.tacfi this card, 
conplete~the other card, and mail/it as soon as possible. 
.No postage* is -necessary. Thank^ou jor your help. 

■/ * 

" " ' * Cordially, 



Donald G. Smith 
Project Leader 



Thh noon H •uthorfwdbv U* (» UAtt-IHl e-1). WhU« ' . . M1.M194 

PSU 'Soi' 1_ Individual' No . 

We have attempted to. contact you recently regarding your par- * 
m ticipation in' the National Assessment j>£ Educational Progress. 
. However, we have been unable to reach you. Please send us your 
- current address and birth date. i * 



Name; 
Street: 



. City /State: J_ 



A. 



Telephone:. ( / ) ^ 



..Zip: 



\ Signed 



J__ 



• NIE. Form No. 2388-5- 
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^ > INVENTORY OP NAE? MATERIALS STORED AT RTI 




Item * 

1. Rulers (15'cm.) 

2. ' Rulers (18") 

i ' 

3. Protractors (4") 

4. Rulers (12") 

5.. Paper Thermometer (72 ) 

6. Paper Thermometer (-10°) 

7. Faper Thermometer (10°) 

8. Pa^er Thermometer (40 ) 

*9« , Papett. Thermometer (gyable) 
* 10. Blue Dice 

.Cone (space figure) 
12 4 Pyramid (jfpace figure) 
13. Sphere (space figure) 
14« Cube (space figure) 

15. Cylinder (spa^e^figure) 

16. Circle* (plane figure) * 
17 „ Square (plane figure) 
J.8. Triangle (plax^figurf) 
19. ^ Rectangle (plane figure) 

Ellipse (plane figure) 
2*7~-?lasti'c boards (7 ft x 15") ' 
22., String (12") 
23. Rope loops (large and small) 
2£. * False-jbottom box 
25 • Spinner (black stick) 



/ 



Quantity 



1 




4 



777 
409 
4Q5 
970 
237 
221 
215 
241 
160 
550 
.278 



277 



120' 



28? 
276 
276 
305 
323 ' 
303 
303. 
307 ' 
*141 
326 , , 
122 sees 
286 
284 



H-2 



V 



r Item 

1 

26 . Square, (pink plastic) 

27. * Handout cards (nuabers) 

28. Protractor (6") N " 

,{•')■ 
.29. Cl^ck dial (paper) 

< • 

30. Spinner tfl» 
• 31, Spinner #2 « 

32, Softballs %l 

33. Qiaxxge drawers* •* ,/ ? 

34, Stopwatches * 

i5» Job pictures and job -title chrds . 
"36: Alarm Clocks' 

' 37, Dictionaries 

m • 

35. Si* piece plastic puzzle 



V 



39 



T 

al cylinder 



40v Carrying cases foirlarge painting 

"9 

41. Cardboard tubes with lenses f 

42. Magnet and washer sets 

43. TI-1200 calculators 

44. Pencils (Venus r-B) . * , 

* ' ^ — ^ 

45. Black flair pens (fine point)* 

46. Blue flail: pens, (fine, point) 

i f 
47* Esterbtook black pens (broad point) 

48. Compass • ^ fc 

49 f Art picture (handout no. 1) 
» 

50Vf. Art picture (handout no. 2) 



'Quantity ^ 



257 

t 

124 * 

271 ■ . 
'.119 • 
263 . 
162 
48 
124 

s 

163 
,283 
173 " 
263' 
290- 
% 260 

27 V ' 
675 
730 
154 
8 gross^ 
^2 dozen- * 
m 2 dorzen 
2 dozen 
73 dozen „ M 



( 



1,389 
902 



ERIC 




* • 



• - • • Item 

~ — * - 

51. ; Art picture (handout no. 3) , * 

52. Art picture (hartdoiit no.' 4) 

• • * 

'53. Art. picture (handout' not *5) 
'.ii; RulerS (12" narked) ' ' < ■ 

55. Film '.'Vandalism: .Crime >f Prank" (YR 03) " 

56. Film "Job Interview" (IR.05) (COD) . 

■57. Film "Management "Sk£ lis and Staff Meeting" 

58. ' Film H OS AC 2 & 3 Plcg. 8 & 14 reap.'" * 

59. .FilaYR 05 AC 2 & 3 Pkg. 13 (both AC) * 



Quantity 

' 940 
* 

1,2*33 l( 
1,397 
• 113 

V 

- j 
13 . 

>- 2 

34 

. 30 



•A 




ERJC " v 
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> Miscellaneous Items 



Item 4 ^ Quantity 

1. Panasonic recorders * 1<f 

2. Briefdases (12 n x 17" x 4tf M green) 1 \ , _ 91 

< 

3. Briefcases (12" x 17" x 3%" black) v . 131 
.4. Hardshells ^ 28 

- 5. Green trunks (7' jT14" x 25") ■ 20 , 

p 

6. NAEP #10 window envelopes (buff) 3,500 

, 7i NAEP continuous form stationery (bu£3E} . 2,500 sheets 

8* NAEP #10 white envelopes 2,000 

• 9. NAEP. gaa clasp 10" s 13" envelope 300 

w 

10, NAEP Newsletter subscription 'cards 500 

11. NAEP business reply envelopes 1,500 

,12. ECS continuous fona stationery (white) 5,100 sheets 

13. ECS Tan Kraf t( 9" x 12" envelopes • * . 1,800 

ft % 

14. ECS white* envelopes 10" x 13" .250 

15. ' ECS #10 white window envelopes 1,500 

IS, *Suntan Kraft clasp envelopes 6" x 9" - " 1,800 

» 

17. SIP storage envelopes / 300 

lk. 'Duo-Tang^ y 350 ^ 

3 m 

19. #10 white envelopes _ 500 

4 

20; #10 white envelopes with ,15? postage * " 500 

21. -Year IX Demonstration Paiges • * 300 

22. White 6 3/4 envelopes with postage , 300 

23. Update on Education C> 46 

24. j?2 Pencils, *» 5 gross 
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